Jul 29 01:09:14.908541 ip-10-0-139-48 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:09:15.355479 ip-10-0-139-48 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:15.355479 ip-10-0-139-48 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:09:15.355479 ip-10-0-139-48 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:15.355479 ip-10-0-139-48 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:09:15.355479 ip-10-0-139-48 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:15.356572 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.356478    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:09:15.364948 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364921    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:15.364948 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364947    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:15.364948 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364951    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364957    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364962    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364967    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364970    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364974    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364977    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364980    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364983    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364985    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364988    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364991    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364993    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364996    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.364999    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365003    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365005    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365008    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365011    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:15.365058 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365014    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365016    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365019    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365022    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365024    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365027    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365030    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365032    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365035    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365038    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365040    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365044    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365047    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365050    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365053    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365056    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365059    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365062    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365065    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:15.365559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365068    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365071    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365073    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365076    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365079    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365082    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365085    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365087    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365090    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365093    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365095    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365098    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365101    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365103    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365106    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365109    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365111    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365115    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365120    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365123    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:15.366062 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365126    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365130    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365133    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365137    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365142    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365145    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365147    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365150    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365153    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365157    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365160    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365162    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365165    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365167    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365170    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365173    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365176    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365179    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365192    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365195    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:15.366583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365198    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365201    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365204    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365206    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365209    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365212    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365215    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365217    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365220    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365222    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365225    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365228    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365230    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365233    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365236    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365239    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365245    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365247    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.365250    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366011    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:15.367076 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366017    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366021    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366024    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366027    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366029    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366033    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366035    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366038    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366041    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366043    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366046    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366049    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366051    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366054    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366057    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366060    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366063    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366065    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366068    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366071    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:15.367583 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366073    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366076    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366079    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366082    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366084    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366087    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366089    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366092    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366096    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366098    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366101    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366104    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366107    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366109    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366112    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366114    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366118    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366120    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366122    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366125    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:15.368088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366127    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366130    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366132    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366135    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366138    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366141    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366144    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366146    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366148    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366151    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366153    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366156    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366158    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366161    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366163    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366167    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366171    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366176    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:15.368650 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366180    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366198    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366201    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366204    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366207    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366214    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366217    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366220    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366223    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366225    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366228    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366231    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366233    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366236    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366239    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366241    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366244    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366247    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366249    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366253    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:15.369088 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366257    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366259    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366262    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366265    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366268    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366271    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366273    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366275    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366278    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366280    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366283    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366285    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366288    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366291    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366293    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366296    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366299    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366302    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366304    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366307    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:15.369617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366689    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366694    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366697    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366700    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366702    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366705    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366708    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366710    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366713    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366716    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366719    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366721    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366724    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366727    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366729    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366731    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366734    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366737    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366740    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366742    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:15.370122 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366745    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366748    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366751    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366753    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366756    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366759    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366761    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366764    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366767    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366770    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366772    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366775    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366777    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366780    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366782    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366785    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366787    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366790    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366792    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366795    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:15.370629 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366797    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366800    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366802    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366806    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366808    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366811    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366813    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366816    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366818    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366821    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366823    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366826    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366828    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366831    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366837    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366840    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366842    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366845    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366847    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366850    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:15.371119 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366852    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366855    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366860    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366864    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366867    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366870    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366873    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366877    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366880    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366882    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366885    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366888    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366891    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366894    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366897    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366900    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366903    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366906    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366909    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:15.371622 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366911    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366915    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366920    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366923    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366925    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366930    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366933    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366938    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366940    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366943    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366946    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366949    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366952    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366955    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366957    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366960    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366963    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366965    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366968    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.366970    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:15.372079 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367061    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367069    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367076    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367081    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367085    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367088    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367093    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367097    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367101    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367104    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367108    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367111    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367115    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367118    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367121    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367124    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367127    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367131    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367135    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367140    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367143    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367146    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367150    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367153    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:09:15.372592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367156    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367160    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367163    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367166    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367169    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367173    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367176    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367179    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367198    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367201    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367204    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367207    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367211    2563 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367214    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367219    2563 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367222    2563 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367225    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367228    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367231    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367235    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367238    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367242    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367245    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367248    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367252    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:09:15.373244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367255    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367258    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367262    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367266    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367268    2563 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367273    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367276    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367279    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367283    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367286    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367289    2563 flags.go:64] FLAG: --help="false"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367292    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367296    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367299    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367302    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367305    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367308    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367311    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367314    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367317    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367320    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367323    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367326    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367329    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:09:15.373891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367332    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367335    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367338    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367341    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367345    2563 flags.go:64] FLAG: --lock-file=""
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367347    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367350    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367354    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367359    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367362    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367366    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367369    2563 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367372    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367376    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367379    2563 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367381    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367385    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367389    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367393    2563 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367396    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367399    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367402    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367405    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367408    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367411    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:09:15.374555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367414    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367421    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367424    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367427    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367430    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367433    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367439    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367443    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367446    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367449    2563 flags.go:64] FLAG: --port="10250"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367452    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367456    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c13479e0fb4db778"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367459    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367462    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367465    2563 flags.go:64] FLAG: --register-node="true"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367468    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367472    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367475    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367480    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367483    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367487    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367490    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367493    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367496    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367499    2563 flags.go:64] FLAG: --runonce="false"
Jul 29 01:09:15.375232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367502    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367506    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367509    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367512    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367515    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367518    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367521    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367524    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367527    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367530    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367533    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367536    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367539    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367542    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367545    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367550    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367554    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367557    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367561    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367564    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367567    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367571    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367574    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367577    2563 flags.go:64] FLAG: --v="2"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367581    2563 flags.go:64] FLAG: --version="false"
Jul 29 01:09:15.375861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367586    2563 flags.go:64] FLAG: --vmodule=""
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367590    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.367593    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367715    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367719    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367722    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367725    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367728    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367731    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367735    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367739    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367742    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367745    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367749    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367752    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367755    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367758    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367760    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367763    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:15.376869 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367765    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367768    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367771    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367774    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367776    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367779    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367781    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367784    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367788    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367791    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367794    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367797    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367800    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367804    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367807    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367809    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367812    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367814    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367817    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367820    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:15.377579 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367822    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367825    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367828    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367830    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367833    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367835    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367838    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367841    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367844    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367846    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367849    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367851    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367854    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367857    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367859    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367862    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367864    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367867    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367869    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:15.378082 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367872    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367875    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367879    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367882    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367884    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367887    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367890    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367893    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367895    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367898    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367901    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367904    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367907    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367909    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367912    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367914    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367917    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367920    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367922    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367925    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:15.378612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367928    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367930    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367933    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367935    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367938    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367941    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367944    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367948    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367951    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367953    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367956    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367958    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367961    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367963    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367967    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367975    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367978    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367980    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367984    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367986    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:15.379113 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367989    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367991    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367994    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.367997    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.368706    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.377609    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.377627    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.377642    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.377648    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377710    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377715    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377718    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377721    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377724    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377727    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:15.379612 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377730    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377733    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377736    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377738    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377741    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377745    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377749    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377752    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377755    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377758    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377761    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377763    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377766    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377769    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377772    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377774    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377777    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377780    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377783    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:15.379992 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377786    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377788    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377791    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377794    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377797    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377800    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377803    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377805    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377809    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377811    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377814    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377817    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377820    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377822    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377825    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377828    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377831    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377833    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377836    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377838    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:15.380470 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377841    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377843    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377846    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377848    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377851    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377854    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377856    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377859    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377861    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377864    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377867    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377869    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377872    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377874    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377877    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377879    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377883    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377885    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377888    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377891    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:15.381010 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377894    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377896    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377898    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377901    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377903    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377906    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377908    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377911    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377913    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377916    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377918    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377921    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377923    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377926    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377930    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377932    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377935    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377937    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377941    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:15.381535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377945    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377948    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377950    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377953    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377956    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377958    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377961    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377965    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377968    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377972    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377975    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377978    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377981    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377984    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.377987    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:15.382047 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.377992    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378137    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378142    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378145    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378149    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378151    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378154    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378157    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378160    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378162    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378165    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378167    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378170    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378173    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378175    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378178    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378180    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378200    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378203    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378206    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:15.382535 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378208    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378211    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378214    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378216    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378219    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378222    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378226    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378229    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378232    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378235    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378237    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378240    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378242    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378245    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378248    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378250    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378253    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378255    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378258    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378260    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:15.383020 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378263    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378265    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378268    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378271    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378273    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378276    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378280    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378283    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378285    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378288    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378290    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378293    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378296    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378301    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378304    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378308    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378311    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378314    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378318    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:15.383546 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378322    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378326    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378329    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378332    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378335    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378339    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378341    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378344    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378347    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378350    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378353    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378355    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378358    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378360    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378363    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378366    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378368    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378371    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378373    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:15.384007 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378376    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378379    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378381    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378384    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378387    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378390    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378392    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378395    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378397    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378400    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378403    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378405    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378408    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378410    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378413    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378415    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378418    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378421    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378423    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:15.384492 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378426    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378428    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:15.378431    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.378435    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.378561    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.382779    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.384437    2563 server.go:1019] "Starting client certificate rotation"
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.384549    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:09:15.384960 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.384586    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:09:15.387257 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.387241    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:09:15.388456 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.388435    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:09:15.404563 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.404538    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:09:15.407367 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.407348    2563 log.go:25] "Validated CRI v1 image API"
Jul 29 01:09:15.408296 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.408278    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:09:15.412064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.412028    2563 fs.go:135] Filesystem UUIDs: map[1f9cf08f-8889-489f-a9e8-8c490fea6e71:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9776d956-478c-447a-9e39-28a97ac42e3f:/dev/nvme0n1p3]
Jul 29 01:09:15.412122 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.412068    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:09:15.418276 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.418254    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:09:15.419800 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.419610    2563 manager.go:216] Machine: {Timestamp:2026-07-29 01:09:15.417895632 +0000 UTC m=+0.379892634 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100012 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21e61049e0ad82c0e08dcc5f56196c SystemUUID:ec21e610-49e0-ad82-c0e0-8dcc5f56196c BootID:c69441db-f401-41fc-aafc-8e75e54d2bed Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:f5:53:08:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:f5:53:08:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:ad:38:e0:c0:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:09:15.419800 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.419795    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:09:15.420002 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.419987    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:09:15.423711 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.423666    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:09:15.423859 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.423709    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:09:15.424535 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.424523    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:09:15.424571 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.424537    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:09:15.424571 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.424546    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:09:15.424571 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.424560    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:09:15.426476 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.426461    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:09:15.431333 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431315    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:09:15.431464 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431453    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:09:15.431504 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431485    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:09:15.431504 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431495    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:09:15.431560 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431512    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:09:15.431560 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431521    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:09:15.431560 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.431531    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:09:15.432064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.432045    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:09:15.432116 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.432083    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:09:15.435852 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.435829    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:09:15.438029 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438008    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:09:15.438141 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438047    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:09:15.438776 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438761    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:09:15.438846 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438781    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:09:15.438846 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438791    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:09:15.438846 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438798    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:09:15.438846 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438810    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:09:15.438846 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438818    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:09:15.439038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438889    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:09:15.439038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438898    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:09:15.439038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438909    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:09:15.439038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438918    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:09:15.439038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438931    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:09:15.439038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.438943    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:09:15.440645 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.440633    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:09:15.440698 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.440648    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:09:15.444013 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.443990    2563 server.go:1268] "Started kubelet"
Jul 29 01:09:15.444123 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.444092    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:09:15.444198 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.444111    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:09:15.444262 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.444225    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:09:15.444983 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.444837    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:09:15.444983 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.444906    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:09:15.445122 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.444983    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:09:15.444998 ip-10-0-139-48 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:09:15.445435 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.445411    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:09:15.449795 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.449770    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:09:15.452736 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.452712    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:09:15.454415 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.451074    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c69d64133bd490  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-29 01:09:15.443958928 +0000 UTC m=+0.405955957,LastTimestamp:2026-07-29 01:09:15.443958928 +0000 UTC m=+0.405955957,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 29 01:09:15.458884 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.458857    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:09:15.458953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.458874    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:09:15.459059 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.459039    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.459897 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.459876    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:09:15.459897 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.459881    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:09:15.460033 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.459919    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:09:15.460033 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.459989    2563 factory.go:55] Registering systemd factory
Jul 29 01:09:15.460129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460037    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:09:15.460129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460072    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:09:15.460129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460080    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:09:15.460376 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460361    2563 factory.go:153] Registering CRI-O factory
Jul 29 01:09:15.460376 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460376    2563 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:09:15.460483 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460435    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:09:15.460483 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460463    2563 factory.go:103] Registering Raw factory
Jul 29 01:09:15.460483 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.460480    2563 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:09:15.461067 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.461052    2563 manager.go:349] Starting recovery of all containers
Jul 29 01:09:15.461662 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.461630    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 01:09:15.461877 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.461832    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 01:09:15.472752 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.472726    2563 manager.go:354] Recovery completed
Jul 29 01:09:15.476421 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.476399    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-68hgp"
Jul 29 01:09:15.477202 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.477176    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.479126 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479106    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.479233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479141    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.479233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479175    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.479768 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479751    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:09:15.479768 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479766    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:09:15.479904 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479778    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.479904 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.479787    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:09:15.480454 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.480438    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.480531 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.480470    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.480531 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.480485    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.482107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.482090    2563 policy_none.go:49] "None policy: Start"
Jul 29 01:09:15.482107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.482106    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:09:15.482303 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.482119    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:09:15.484322 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.484308    2563 policy_none.go:47] "Start"
Jul 29 01:09:15.485470 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.485450    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-68hgp"
Jul 29 01:09:15.487425 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.487350    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c69d6415546fcd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-29 01:09:15.479125965 +0000 UTC m=+0.441123156,LastTimestamp:2026-07-29 01:09:15.479125965 +0000 UTC m=+0.441123156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 29 01:09:15.489700 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.489606    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c69d641554bf72  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-29 01:09:15.479146354 +0000 UTC m=+0.441143352,LastTimestamp:2026-07-29 01:09:15.479146354 +0000 UTC m=+0.441143352,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 29 01:09:15.520929 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.520895    2563 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:09:15.521072 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.520942    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:09:15.521072 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.520955    2563 server.go:87] "Starting device plugin registration server"
Jul 29 01:09:15.521328 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.521313    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:09:15.521445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.521331    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:09:15.521562 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.521543    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:09:15.521645 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.521633    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:09:15.521645 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.521644    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:09:15.522198 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.522154    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:09:15.522427 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.522235    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.546573 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.536840    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:09:15.546573 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.537990    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:09:15.546573 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.538041    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:09:15.546573 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.538068    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:09:15.546573 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.538109    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:09:15.546573 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.540631    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:15.621779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.621754    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.623448 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.623429    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.623538 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.623462    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.623538 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.623473    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.623538 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.623502    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.633058 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.633033    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.633135 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.633063    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-48.ec2.internal\": node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.638248 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.638221    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"]
Jul 29 01:09:15.638402 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.638287    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.639373 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.639355    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.639461 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.639393    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.639461 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.639409    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.641971 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.641947    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.642083 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.642148 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642085    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.642907 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642887    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.643008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642919    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.643008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642930    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.643008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642886    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.643008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.642991    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.643008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.643005    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.645484 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.645456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.645585 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.645513    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:15.646555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.646527    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:15.646657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.646564    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:15.646657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.646579    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:15.661260 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.661226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b09ebececb05ce8f572d27642add05d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"5b09ebececb05ce8f572d27642add05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.661260 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.661266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b09ebececb05ce8f572d27642add05d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"5b09ebececb05ce8f572d27642add05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.661467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.661285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48f231bcc996df8559b089b6a3f5330f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"48f231bcc996df8559b089b6a3f5330f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.665309 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.665284    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.679585 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.679563    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-48.ec2.internal\" not found" node="ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.683812 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.683790    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-48.ec2.internal\" not found" node="ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.762203 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.761991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b09ebececb05ce8f572d27642add05d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"5b09ebececb05ce8f572d27642add05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.762203 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.762210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b09ebececb05ce8f572d27642add05d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"5b09ebececb05ce8f572d27642add05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.762420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.762229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48f231bcc996df8559b089b6a3f5330f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"48f231bcc996df8559b089b6a3f5330f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.762420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.762086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b09ebececb05ce8f572d27642add05d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"5b09ebececb05ce8f572d27642add05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.762420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.762269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b09ebececb05ce8f572d27642add05d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"5b09ebececb05ce8f572d27642add05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.762420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.762278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/48f231bcc996df8559b089b6a3f5330f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"48f231bcc996df8559b089b6a3f5330f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.766269 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.766249    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.867336 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.867301    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.968284 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:15.968215    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:15.983433 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.983402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:15.988214 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:15.988176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:16.069139 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.069091    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.169356 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.169318    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.254952 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.254864    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:16.269532 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.269479    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.369697 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.369646    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.384028 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.383997    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:09:16.384187 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.384166    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:09:16.384270 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.384218    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:09:16.470326 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.470279    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.492347 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.492288    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:04:16 +0000 UTC" deadline="2028-04-08 18:53:03.975856514 +0000 UTC"
Jul 29 01:09:16.492347 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.492339    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14873h43m47.483521297s"
Jul 29 01:09:16.570774 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.570739    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.638659 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.638619    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:16.640150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.640129    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:16.640236 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.640173    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:16.640236 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.640188    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:16.671584 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.671547    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.673921 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:16.673873    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b09ebececb05ce8f572d27642add05d.slice/crio-b771b9cf2f4b3ddcd98fc9d24c26702b7d741096bfc2f550536baf34e3ae4f93 WatchSource:0}: Error finding container b771b9cf2f4b3ddcd98fc9d24c26702b7d741096bfc2f550536baf34e3ae4f93: Status 404 returned error can't find the container with id b771b9cf2f4b3ddcd98fc9d24c26702b7d741096bfc2f550536baf34e3ae4f93
Jul 29 01:09:16.676128 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:16.676099    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f231bcc996df8559b089b6a3f5330f.slice/crio-6223681d4595a0a7365949e9d783e060fc3177470bdbad11a402a5168f519c68 WatchSource:0}: Error finding container 6223681d4595a0a7365949e9d783e060fc3177470bdbad11a402a5168f519c68: Status 404 returned error can't find the container with id 6223681d4595a0a7365949e9d783e060fc3177470bdbad11a402a5168f519c68
Jul 29 01:09:16.683335 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.683308    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:09:16.772273 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:16.772232    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 29 01:09:16.775101 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.775080    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:16.802452 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.802381    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:16.862798 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.862756    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:16.877380 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.877351    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:09:16.878619 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.878601    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 29 01:09:16.887504 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:16.887483    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:09:17.432706 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.432659    2563 apiserver.go:52] "Watching apiserver"
Jul 29 01:09:17.439663 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.439632    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:09:17.441495 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.441457    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-v8q48","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68","openshift-image-registry/node-ca-b5jxs","openshift-multus/multus-2vdwn","openshift-multus/network-metrics-daemon-z4z76","openshift-network-diagnostics/network-check-target-vnmpv","openshift-ovn-kubernetes/ovnkube-node-nc64g","kube-system/global-pull-secret-syncer-2gbcw","kube-system/konnectivity-agent-g7pms","kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7mrl6","openshift-dns/node-resolver-4hggq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal","openshift-multus/multus-additional-cni-plugins-s9fc8"]
Jul 29 01:09:17.445006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.444969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.449953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.449449    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:09:17.449953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.449518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:09:17.449953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.449745    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.449953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.449745    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.449953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.449922    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:09:17.450610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.449453    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-28lgg\""
Jul 29 01:09:17.450610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.450514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.450610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.450558    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:09:17.450794 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.450760    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.453194 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.452509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.454506 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.454478    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6gxx7\""
Jul 29 01:09:17.454793 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.454769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x9zmc\""
Jul 29 01:09:17.455053 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455034    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.455404 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455384    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.455658 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:17.455759 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455730    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:09:17.455822 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455759    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.455822 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.455759    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:17.455981 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455966    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vp67g\""
Jul 29 01:09:17.455981 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.455975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.456180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.456091    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:09:17.456180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.456179    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.456369 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.456209    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.456369 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.456344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:09:17.457756 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.457734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:17.457876 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.457820    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:17.460804 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.460778    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:09:17.461590 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.461567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.463737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.463711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.463972 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.463950    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:09:17.464155 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.464134    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:09:17.464228 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.464176    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-scs94\""
Jul 29 01:09:17.465691 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.465668    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:09:17.466091 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.466073    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:09:17.468447 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.468420    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8spf\""
Jul 29 01:09:17.473692 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.473665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.474138 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.473913    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:09:17.474587 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-ovn\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.474919 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-netns\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.474919 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrwmn\" (UniqueName: \"kubernetes.io/projected/4ce56aef-1689-4ec9-b2bd-687357a6a87a-kube-api-access-lrwmn\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.474919 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-socket-dir-parent\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-cni-bin\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e08ee925-2bdf-440b-b76f-189cebc8b23f-agent-certs\") pod \"konnectivity-agent-g7pms\" (UID: \"e08ee925-2bdf-440b-b76f-189cebc8b23f\") " pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.474986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-log-socket\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-cni-bin\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-env-overrides\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3580c323-cdef-46f3-b168-285944ce1d46-etc-tuned\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.475089 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wh7q\" (UniqueName: \"kubernetes.io/projected/3580c323-cdef-46f3-b168-285944ce1d46-kube-api-access-7wh7q\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-system-cni-dir\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-var-lib-kubelet\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-multus-certs\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7q6\" (UniqueName: \"kubernetes.io/projected/111302ec-d28b-4bf8-afd1-90748433ee2f-kube-api-access-nr7q6\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cnibin\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-systemd-units\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-kubernetes\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-lib-modules\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.475481 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-host\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/111302ec-d28b-4bf8-afd1-90748433ee2f-ovn-node-metrics-cert\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ce56aef-1689-4ec9-b2bd-687357a6a87a-serviceca\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysctl-d\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysctl-conf\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-run\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3580c323-cdef-46f3-b168-285944ce1d46-tmp\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-hostroot\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfnch\" (UniqueName: \"kubernetes.io/projected/145a696f-67d9-4dbb-b23c-96cb743856a4-kube-api-access-vfnch\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-cnibin\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-cni-netd\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-modprobe-d\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-k8s-cni-cncf-io\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-daemon-config\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.475973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-etc-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-node-log\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-sys\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-run-netns\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-systemd\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-ovnkube-config\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-systemd\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476450    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ce56aef-1689-4ec9-b2bd-687357a6a87a-host\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ccsx7\""
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-ovnkube-script-lib\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-os-release\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzgqv\" (UniqueName: \"kubernetes.io/projected/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-kube-api-access-hzgqv\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-os-release\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.476879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-cni-multus\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-kubelet\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e08ee925-2bdf-440b-b76f-189cebc8b23f-konnectivity-ca\") pod \"konnectivity-agent-g7pms\" (UID: \"e08ee925-2bdf-440b-b76f-189cebc8b23f\") " pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-cni-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/145a696f-67d9-4dbb-b23c-96cb743856a4-cni-binary-copy\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476758    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-etc-kubernetes\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysconfig\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-system-cni-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-conf-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnk6k\" (UniqueName: \"kubernetes.io/projected/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-kube-api-access-jnk6k\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-kubelet\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.476956    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-slash\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.477725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.476995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-var-lib-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.480326 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.480303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.482488 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.482466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.482757 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.482737    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:09:17.483035 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.483014    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.483116 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.483080    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.483471 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.483451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z47m8\""
Jul 29 01:09:17.486479 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.486455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xrpdj\""
Jul 29 01:09:17.486581 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.486515    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:09:17.486746 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.486725    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:09:17.499113 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.499073    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-djhq8"
Jul 29 01:09:17.507203 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.507157    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-djhq8"
Jul 29 01:09:17.544817 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.544753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" event={"ID":"48f231bcc996df8559b089b6a3f5330f","Type":"ContainerStarted","Data":"6223681d4595a0a7365949e9d783e060fc3177470bdbad11a402a5168f519c68"}
Jul 29 01:09:17.547326 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.547293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"5b09ebececb05ce8f572d27642add05d","Type":"ContainerStarted","Data":"b771b9cf2f4b3ddcd98fc9d24c26702b7d741096bfc2f550536baf34e3ae4f93"}
Jul 29 01:09:17.561810 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.561773    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:09:17.577498 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrwmn\" (UniqueName: \"kubernetes.io/projected/4ce56aef-1689-4ec9-b2bd-687357a6a87a-kube-api-access-lrwmn\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-socket-dir-parent\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-cni-bin\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e08ee925-2bdf-440b-b76f-189cebc8b23f-agent-certs\") pod \"konnectivity-agent-g7pms\" (UID: \"e08ee925-2bdf-440b-b76f-189cebc8b23f\") " pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-log-socket\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-cni-bin\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-env-overrides\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3580c323-cdef-46f3-b168-285944ce1d46-etc-tuned\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.577707 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wh7q\" (UniqueName: \"kubernetes.io/projected/3580c323-cdef-46f3-b168-285944ce1d46-kube-api-access-7wh7q\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-system-cni-dir\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-var-lib-kubelet\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-multus-certs\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7q6\" (UniqueName: \"kubernetes.io/projected/111302ec-d28b-4bf8-afd1-90748433ee2f-kube-api-access-nr7q6\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cnibin\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.577985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-registration-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bn9\" (UniqueName: \"kubernetes.io/projected/72029676-fdd6-4746-93ef-51b93cdea875-kube-api-access-k7bn9\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-systemd-units\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-device-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.578120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-kubernetes\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-lib-modules\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-host\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-dbus\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-sys-fs\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-cni-bin\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/111302ec-d28b-4bf8-afd1-90748433ee2f-ovn-node-metrics-cert\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-socket-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ce56aef-1689-4ec9-b2bd-687357a6a87a-serviceca\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysctl-d\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysctl-conf\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-run\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3580c323-cdef-46f3-b168-285944ce1d46-tmp\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-hostroot\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.578761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfnch\" (UniqueName: \"kubernetes.io/projected/145a696f-67d9-4dbb-b23c-96cb743856a4-kube-api-access-vfnch\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72029676-fdd6-4746-93ef-51b93cdea875-hosts-file\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-cnibin\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-cni-netd\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578708    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-system-cni-dir\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9h9w\" (UniqueName: \"kubernetes.io/projected/a9ebe96a-1079-49a6-9e21-d765479a847b-kube-api-access-d9h9w\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7609233a-7f8f-40c7-b409-80ff7bcfc480-host-slash\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-modprobe-d\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-k8s-cni-cncf-io\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.578980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-daemon-config\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-etc-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-node-log\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tg4\" (UniqueName: \"kubernetes.io/projected/7609233a-7f8f-40c7-b409-80ff7bcfc480-kube-api-access-x5tg4\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-sys\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.579647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-run-netns\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-systemd\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-host\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-ovnkube-config\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-kubelet-config\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-systemd\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-socket-dir-parent\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ce56aef-1689-4ec9-b2bd-687357a6a87a-host\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-ovnkube-script-lib\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-os-release\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzgqv\" (UniqueName: \"kubernetes.io/projected/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-kube-api-access-hzgqv\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-modprobe-d\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-os-release\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.580466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579651    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-k8s-cni-cncf-io\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-os-release\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-cni-multus\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-kubelet\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-var-lib-kubelet\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e08ee925-2bdf-440b-b76f-189cebc8b23f-konnectivity-ca\") pod \"konnectivity-agent-g7pms\" (UID: \"e08ee925-2bdf-440b-b76f-189cebc8b23f\") " pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72029676-fdd6-4746-93ef-51b93cdea875-tmp-dir\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-multus-certs\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7609233a-7f8f-40c7-b409-80ff7bcfc480-iptables-alerter-script\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-cni-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/145a696f-67d9-4dbb-b23c-96cb743856a4-cni-binary-copy\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.581293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.579943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-etc-kubernetes\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.582104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.582658    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysconfig\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.582797    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:09:18.082732293 +0000 UTC m=+3.044729297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysconfig\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-system-cni-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-conf-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnk6k\" (UniqueName: \"kubernetes.io/projected/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-kube-api-access-jnk6k\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.582970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-kubelet\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-slash\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-var-lib-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-ovn\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-netns\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-run-netns\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-daemon-config\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.583944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysctl-d\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.586379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-log-socket\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-etc-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-cni-bin\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-node-log\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-env-overrides\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-cni-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.584997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-sys\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585069    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-run-netns\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/145a696f-67d9-4dbb-b23c-96cb743856a4-cni-binary-copy\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-systemd\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-etc-kubernetes\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-cni-multus\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-host-var-lib-kubelet\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-system-cni-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-multus-conf-dir\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-kubelet\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-slash\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.588354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e08ee925-2bdf-440b-b76f-189cebc8b23f-konnectivity-ca\") pod \"konnectivity-agent-g7pms\" (UID: \"e08ee925-2bdf-440b-b76f-189cebc8b23f\") " pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.585950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-var-lib-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.586021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-ovn\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.586142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.586211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cnibin\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.586824    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.586964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-systemd-units\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-kubernetes\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-lib-modules\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-run-openvswitch\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ce56aef-1689-4ec9-b2bd-687357a6a87a-serviceca\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-ovnkube-config\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-systemd\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.589482 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.587998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ce56aef-1689-4ec9-b2bd-687357a6a87a-host\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.590139 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.590085    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:17.590139 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.590120    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:17.590139 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.590135    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:17.590302 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.590215    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:18.090192863 +0000 UTC m=+3.052189871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:17.591107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.590377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/111302ec-d28b-4bf8-afd1-90748433ee2f-ovnkube-script-lib\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.591107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.590531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-os-release\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.591107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.590705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-cnibin\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.591107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.590822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-run\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.591107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.590963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.591107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.590973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3580c323-cdef-46f3-b168-285944ce1d46-etc-sysctl-conf\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.591505 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.591163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/111302ec-d28b-4bf8-afd1-90748433ee2f-host-cni-netd\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.591572 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.591522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/145a696f-67d9-4dbb-b23c-96cb743856a4-hostroot\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.592028 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.591697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.593894 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.593867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3580c323-cdef-46f3-b168-285944ce1d46-tmp\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.596282 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.595964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/111302ec-d28b-4bf8-afd1-90748433ee2f-ovn-node-metrics-cert\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.596282 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.596038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrwmn\" (UniqueName: \"kubernetes.io/projected/4ce56aef-1689-4ec9-b2bd-687357a6a87a-kube-api-access-lrwmn\") pod \"node-ca-b5jxs\" (UID: \"4ce56aef-1689-4ec9-b2bd-687357a6a87a\") " pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.601074 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.600958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e08ee925-2bdf-440b-b76f-189cebc8b23f-agent-certs\") pod \"konnectivity-agent-g7pms\" (UID: \"e08ee925-2bdf-440b-b76f-189cebc8b23f\") " pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.601647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.601507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wh7q\" (UniqueName: \"kubernetes.io/projected/3580c323-cdef-46f3-b168-285944ce1d46-kube-api-access-7wh7q\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.601975 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.601900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnk6k\" (UniqueName: \"kubernetes.io/projected/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-kube-api-access-jnk6k\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:17.602905 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.602827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3580c323-cdef-46f3-b168-285944ce1d46-etc-tuned\") pod \"tuned-7mrl6\" (UID: \"3580c323-cdef-46f3-b168-285944ce1d46\") " pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.604221 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.604193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzgqv\" (UniqueName: \"kubernetes.io/projected/50bb53b8-c7b0-43de-8f1c-e7fc63e1351c-kube-api-access-hzgqv\") pod \"multus-additional-cni-plugins-s9fc8\" (UID: \"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c\") " pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.605318 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.605222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfnch\" (UniqueName: \"kubernetes.io/projected/145a696f-67d9-4dbb-b23c-96cb743856a4-kube-api-access-vfnch\") pod \"multus-2vdwn\" (UID: \"145a696f-67d9-4dbb-b23c-96cb743856a4\") " pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.606867 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.606835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7q6\" (UniqueName: \"kubernetes.io/projected/111302ec-d28b-4bf8-afd1-90748433ee2f-kube-api-access-nr7q6\") pod \"ovnkube-node-nc64g\" (UID: \"111302ec-d28b-4bf8-afd1-90748433ee2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.684070 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.683950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684070 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-registration-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684070 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bn9\" (UniqueName: \"kubernetes.io/projected/72029676-fdd6-4746-93ef-51b93cdea875-kube-api-access-k7bn9\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.684070 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-device-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-dbus\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-sys-fs\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-socket-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72029676-fdd6-4746-93ef-51b93cdea875-hosts-file\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9h9w\" (UniqueName: \"kubernetes.io/projected/a9ebe96a-1079-49a6-9e21-d765479a847b-kube-api-access-d9h9w\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7609233a-7f8f-40c7-b409-80ff7bcfc480-host-slash\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tg4\" (UniqueName: \"kubernetes.io/projected/7609233a-7f8f-40c7-b409-80ff7bcfc480-kube-api-access-x5tg4\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.684445 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-kubelet-config\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72029676-fdd6-4746-93ef-51b93cdea875-tmp-dir\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7609233a-7f8f-40c7-b409-80ff7bcfc480-iptables-alerter-script\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-registration-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-dbus\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-sys-fs\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.684918 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.684903    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:17.685318 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:17.684983    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:18.184960417 +0000 UTC m=+3.146957411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:17.685318 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.684982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-device-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.685318 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.685258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-kubelet-config\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:17.685506 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.685324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9ebe96a-1079-49a6-9e21-d765479a847b-socket-dir\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.685506 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.685394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72029676-fdd6-4746-93ef-51b93cdea875-hosts-file\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.686310 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.685636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72029676-fdd6-4746-93ef-51b93cdea875-tmp-dir\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.686310 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.685726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7609233a-7f8f-40c7-b409-80ff7bcfc480-host-slash\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.686310 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.686241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7609233a-7f8f-40c7-b409-80ff7bcfc480-iptables-alerter-script\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.708830 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.708787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bn9\" (UniqueName: \"kubernetes.io/projected/72029676-fdd6-4746-93ef-51b93cdea875-kube-api-access-k7bn9\") pod \"node-resolver-4hggq\" (UID: \"72029676-fdd6-4746-93ef-51b93cdea875\") " pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.711253 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.711204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tg4\" (UniqueName: \"kubernetes.io/projected/7609233a-7f8f-40c7-b409-80ff7bcfc480-kube-api-access-x5tg4\") pod \"iptables-alerter-v8q48\" (UID: \"7609233a-7f8f-40c7-b409-80ff7bcfc480\") " pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.711427 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.711341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9h9w\" (UniqueName: \"kubernetes.io/projected/a9ebe96a-1079-49a6-9e21-d765479a847b-kube-api-access-d9h9w\") pod \"aws-ebs-csi-driver-node-nfs68\" (UID: \"a9ebe96a-1079-49a6-9e21-d765479a847b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.766773 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.766711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:17.779453 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.779410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mrl6"
Jul 29 01:09:17.792553 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.792248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5jxs"
Jul 29 01:09:17.797968 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.797747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2vdwn"
Jul 29 01:09:17.813876 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.813839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:17.824252 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.824192    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s9fc8"
Jul 29 01:09:17.834449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.834414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68"
Jul 29 01:09:17.844703 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.844666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8q48"
Jul 29 01:09:17.852865 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.852838    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4hggq"
Jul 29 01:09:17.887773 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:17.887738    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:18.087525 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:18.087423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:18.087710 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.087554    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:18.087710 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.087627    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:09:19.087610773 +0000 UTC m=+4.049607759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:18.188838 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:18.188793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:18.189072 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.188985    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:18.189072 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:18.189002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:18.189197 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.189078    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:19.189053941 +0000 UTC m=+4.151050942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:18.189287 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.189189    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:18.189287 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.189229    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:18.189287 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.189241    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:18.189457 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:18.189295    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:19.189277988 +0000 UTC m=+4.151274975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:18.510862 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:18.510816    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:04:17 +0000 UTC" deadline="2028-01-06 10:17:02.669236383 +0000 UTC"
Jul 29 01:09:18.510862 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:18.510853    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12633h7m44.158386685s"
Jul 29 01:09:18.822927 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.822859    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08ee925_2bdf_440b_b76f_189cebc8b23f.slice/crio-d1a876af52dc129d16e1d53368d191d9530dee05b20d1da0ad57c741681384b0 WatchSource:0}: Error finding container d1a876af52dc129d16e1d53368d191d9530dee05b20d1da0ad57c741681384b0: Status 404 returned error can't find the container with id d1a876af52dc129d16e1d53368d191d9530dee05b20d1da0ad57c741681384b0
Jul 29 01:09:18.825507 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.825476    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145a696f_67d9_4dbb_b23c_96cb743856a4.slice/crio-959f02acdba14d219852c2b676b25fdd1b6307f80f8d28a87c650dcb4a599a22 WatchSource:0}: Error finding container 959f02acdba14d219852c2b676b25fdd1b6307f80f8d28a87c650dcb4a599a22: Status 404 returned error can't find the container with id 959f02acdba14d219852c2b676b25fdd1b6307f80f8d28a87c650dcb4a599a22
Jul 29 01:09:18.826563 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.826528    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111302ec_d28b_4bf8_afd1_90748433ee2f.slice/crio-e2ef7e5b67b62f435bc3d3c9c010ad35ca37af3cabf2df38314b7c73b6141308 WatchSource:0}: Error finding container e2ef7e5b67b62f435bc3d3c9c010ad35ca37af3cabf2df38314b7c73b6141308: Status 404 returned error can't find the container with id e2ef7e5b67b62f435bc3d3c9c010ad35ca37af3cabf2df38314b7c73b6141308
Jul 29 01:09:18.827771 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.827745    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ebe96a_1079_49a6_9e21_d765479a847b.slice/crio-259cdab413a50c31e254598a29fce0af8276d09efecac2f7dad3b99128c1460f WatchSource:0}: Error finding container 259cdab413a50c31e254598a29fce0af8276d09efecac2f7dad3b99128c1460f: Status 404 returned error can't find the container with id 259cdab413a50c31e254598a29fce0af8276d09efecac2f7dad3b99128c1460f
Jul 29 01:09:18.828974 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.828946    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bb53b8_c7b0_43de_8f1c_e7fc63e1351c.slice/crio-ce2e95984117d71e3c81c9d80a62bc11a1561b209fdbf22294a03e471778beed WatchSource:0}: Error finding container ce2e95984117d71e3c81c9d80a62bc11a1561b209fdbf22294a03e471778beed: Status 404 returned error can't find the container with id ce2e95984117d71e3c81c9d80a62bc11a1561b209fdbf22294a03e471778beed
Jul 29 01:09:18.854878 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.854848    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce56aef_1689_4ec9_b2bd_687357a6a87a.slice/crio-f042d70aa7c84198b047d372b806a0da17622931e012503897d4072a6480a8da WatchSource:0}: Error finding container f042d70aa7c84198b047d372b806a0da17622931e012503897d4072a6480a8da: Status 404 returned error can't find the container with id f042d70aa7c84198b047d372b806a0da17622931e012503897d4072a6480a8da
Jul 29 01:09:18.856315 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.856284    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7609233a_7f8f_40c7_b409_80ff7bcfc480.slice/crio-48ddb7a8fa2db3f6eea4b3714ad0357839e071391f7d5483978f4c4157fa4aa4 WatchSource:0}: Error finding container 48ddb7a8fa2db3f6eea4b3714ad0357839e071391f7d5483978f4c4157fa4aa4: Status 404 returned error can't find the container with id 48ddb7a8fa2db3f6eea4b3714ad0357839e071391f7d5483978f4c4157fa4aa4
Jul 29 01:09:18.857404 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.857371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3580c323_cdef_46f3_b168_285944ce1d46.slice/crio-146bd2e094120b2642dcc12b4608679c69768a2b412deb458c76dc0fa6d356ab WatchSource:0}: Error finding container 146bd2e094120b2642dcc12b4608679c69768a2b412deb458c76dc0fa6d356ab: Status 404 returned error can't find the container with id 146bd2e094120b2642dcc12b4608679c69768a2b412deb458c76dc0fa6d356ab
Jul 29 01:09:18.858557 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:18.858527    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72029676_fdd6_4746_93ef_51b93cdea875.slice/crio-c24b9d3adf22a457b3490e52cae5ef7e326b8ee6df6946b55b838dfe08e69d90 WatchSource:0}: Error finding container c24b9d3adf22a457b3490e52cae5ef7e326b8ee6df6946b55b838dfe08e69d90: Status 404 returned error can't find the container with id c24b9d3adf22a457b3490e52cae5ef7e326b8ee6df6946b55b838dfe08e69d90
Jul 29 01:09:19.088937 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.088907    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:19.096321 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.096289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:19.096459 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.096441    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:19.096515 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.096504    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:09:21.096489295 +0000 UTC m=+6.058486283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:19.197688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.197446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:19.197895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.197729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:19.197895 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.197611    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:19.197895 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.197816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:21.197797847 +0000 UTC m=+6.159794834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:19.197895 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.197860    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:19.197895 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.197874    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:19.197895 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.197885    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:19.198301 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.198273    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:21.197919309 +0000 UTC m=+6.159916313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:19.511684 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.511563    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:04:17 +0000 UTC" deadline="2028-03-14 22:13:36.714564367 +0000 UTC"
Jul 29 01:09:19.511684 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.511632    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14277h4m17.202937454s"
Jul 29 01:09:19.542344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.541438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:19.542344 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.541588    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:19.542344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.542031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:19.542344 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.542129    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:19.542344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.542193    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:19.542344 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:19.542286    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:19.566378 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.566330    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b09ebececb05ce8f572d27642add05d" containerID="2205691413a1b59eb0a14a85d7d7633d3e8d1727ed8808e180fd6a07005015cf" exitCode=0
Jul 29 01:09:19.566569 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.566449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"5b09ebececb05ce8f572d27642add05d","Type":"ContainerDied","Data":"2205691413a1b59eb0a14a85d7d7633d3e8d1727ed8808e180fd6a07005015cf"}
Jul 29 01:09:19.580964 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.580926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4hggq" event={"ID":"72029676-fdd6-4746-93ef-51b93cdea875","Type":"ContainerStarted","Data":"c24b9d3adf22a457b3490e52cae5ef7e326b8ee6df6946b55b838dfe08e69d90"}
Jul 29 01:09:19.590147 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.590019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mrl6" event={"ID":"3580c323-cdef-46f3-b168-285944ce1d46","Type":"ContainerStarted","Data":"146bd2e094120b2642dcc12b4608679c69768a2b412deb458c76dc0fa6d356ab"}
Jul 29 01:09:19.608753 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.608687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5jxs" event={"ID":"4ce56aef-1689-4ec9-b2bd-687357a6a87a","Type":"ContainerStarted","Data":"f042d70aa7c84198b047d372b806a0da17622931e012503897d4072a6480a8da"}
Jul 29 01:09:19.614804 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.614684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8q48" event={"ID":"7609233a-7f8f-40c7-b409-80ff7bcfc480","Type":"ContainerStarted","Data":"48ddb7a8fa2db3f6eea4b3714ad0357839e071391f7d5483978f4c4157fa4aa4"}
Jul 29 01:09:19.625862 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.625822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerStarted","Data":"ce2e95984117d71e3c81c9d80a62bc11a1561b209fdbf22294a03e471778beed"}
Jul 29 01:09:19.639776 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.639648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"e2ef7e5b67b62f435bc3d3c9c010ad35ca37af3cabf2df38314b7c73b6141308"}
Jul 29 01:09:19.650161 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.650120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2vdwn" event={"ID":"145a696f-67d9-4dbb-b23c-96cb743856a4","Type":"ContainerStarted","Data":"959f02acdba14d219852c2b676b25fdd1b6307f80f8d28a87c650dcb4a599a22"}
Jul 29 01:09:19.661780 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.661741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" event={"ID":"48f231bcc996df8559b089b6a3f5330f","Type":"ContainerStarted","Data":"c088750b78cee98736c871a90ff4d6181879d95b158f256281839c4569d30782"}
Jul 29 01:09:19.679793 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.679747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68" event={"ID":"a9ebe96a-1079-49a6-9e21-d765479a847b","Type":"ContainerStarted","Data":"259cdab413a50c31e254598a29fce0af8276d09efecac2f7dad3b99128c1460f"}
Jul 29 01:09:19.697402 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:19.697357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7pms" event={"ID":"e08ee925-2bdf-440b-b76f-189cebc8b23f","Type":"ContainerStarted","Data":"d1a876af52dc129d16e1d53368d191d9530dee05b20d1da0ad57c741681384b0"}
Jul 29 01:09:20.721392 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:20.721352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"5b09ebececb05ce8f572d27642add05d","Type":"ContainerStarted","Data":"4c3c59f210a7f7f0a0ac241681beb5dcb3b5abcdb9b9fd5f5e1c5890c05b345f"}
Jul 29 01:09:20.739580 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:20.739507    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" podStartSLOduration=3.739481844 podStartE2EDuration="3.739481844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:19.677394869 +0000 UTC m=+4.639391880" watchObservedRunningTime="2026-07-29 01:09:20.739481844 +0000 UTC m=+5.701478854"
Jul 29 01:09:20.739796 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:20.739749    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" podStartSLOduration=3.739739709 podStartE2EDuration="3.739739709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:20.739329684 +0000 UTC m=+5.701326695" watchObservedRunningTime="2026-07-29 01:09:20.739739709 +0000 UTC m=+5.701736722"
Jul 29 01:09:21.115043 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:21.114948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:21.115217 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.115125    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:21.115217 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.115200    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:09:25.115177976 +0000 UTC m=+10.077174972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:21.215783 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:21.215737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:21.215959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:21.215837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:21.216043 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.216015    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:21.216102 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.216045    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:21.216102 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.216059    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:21.216204 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.216125    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:25.216103867 +0000 UTC m=+10.178100857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:21.216632 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.216610    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:21.216740 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.216674    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:25.216656848 +0000 UTC m=+10.178653841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:21.541157 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:21.541111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:21.541418 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.541289    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:21.541718 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:21.541689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:21.541822 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.541798    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:21.541883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:21.541854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:21.542218 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:21.541934    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:23.541378 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:23.541318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:23.541959 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:23.541459    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:23.541959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:23.541615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:23.541959 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:23.541733    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:23.541959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:23.541800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:23.541959 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:23.541869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:25.153339 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:25.153294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:25.153804 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.153469    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:25.153804 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.153547    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.153525017 +0000 UTC m=+18.115522017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:25.253884 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:25.253835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:25.254069 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:25.253938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:25.254129 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.254110    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:25.254180 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.254139    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:25.254180 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.254154    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:25.254299 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.254238    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.254217655 +0000 UTC m=+18.216214644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:25.254717 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.254695    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:25.254774 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.254757    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.254741551 +0000 UTC m=+18.216738551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:25.540004 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:25.539921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:25.540195 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.540025    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:25.540437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:25.540416    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:25.540532 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.540512    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:25.540639 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:25.540626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:25.540759 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:25.540739    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:27.538535 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:27.538400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:27.538535 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:27.538534    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:27.539083 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:27.538410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:27.539083 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:27.538932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:27.539083 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:27.539030    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:27.539257 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:27.539109    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:29.538283 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:29.538245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:29.538283 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:29.538269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:29.538735 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:29.538255    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:29.538735 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:29.538372    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:29.538735 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:29.538432    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:29.538735 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:29.538523    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:31.538464 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:31.538422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:31.539006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:31.538422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:31.539006 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:31.538553    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:31.539006 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:31.538672    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:31.539006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:31.538441    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:31.539006 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:31.538800    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:33.221033 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:33.220991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:33.221571 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.221173    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.221571 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.221270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:09:49.221248378 +0000 UTC m=+34.183245374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.321650 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:33.321612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:33.321836 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:33.321686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:33.321836 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.321791    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.321836 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.321807    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:33.321836 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.321821    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:33.321836 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.321833    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.322068 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.321868    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:49.32184892 +0000 UTC m=+34.283845923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.322068 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.321890    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:49.321880993 +0000 UTC m=+34.283877981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.538680 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:33.538589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:33.538835 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:33.538589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:33.538835 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.538727    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:33.538835 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:33.538738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:33.538835 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.538813    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:33.539024 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:33.538921    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:35.542277 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:35.539964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:35.542277 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:35.540132    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:35.542277 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:35.540640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:35.542277 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:35.540754    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:35.542277 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:35.540806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:35.542277 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:35.540889    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:37.538674 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.538640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:37.539130 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.538640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:37.539130 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:37.538757    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:37.539130 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:37.538805    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:37.539130 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.538640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:37.539130 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:37.538953    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:37.779894 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.779564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerStarted","Data":"fb14a8a617ccb12a29858f8735a42b205d45f48dc4785e27538efdc930b2d8c9"}
Jul 29 01:09:37.782402 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.782364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"5172d181594f36cf34c6957120d4e5cbd3f9931844863732a593790894743e9d"}
Jul 29 01:09:37.784345 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.784307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2vdwn" event={"ID":"145a696f-67d9-4dbb-b23c-96cb743856a4","Type":"ContainerStarted","Data":"fce3355eb994aabf09d1ccef2ede07e6907517431955009e3d322d475be0f702"}
Jul 29 01:09:37.787338 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.787238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68" event={"ID":"a9ebe96a-1079-49a6-9e21-d765479a847b","Type":"ContainerStarted","Data":"c5535be8a05133477b7fabd7065b2240b8e2b39c03a26f81e3dfea1405f512c9"}
Jul 29 01:09:37.789133 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.789023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g7pms" event={"ID":"e08ee925-2bdf-440b-b76f-189cebc8b23f","Type":"ContainerStarted","Data":"77c83f1979513daf5206fd16aa9919ab8a276e64a58b99f2fe167564c789968c"}
Jul 29 01:09:37.791359 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.791328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4hggq" event={"ID":"72029676-fdd6-4746-93ef-51b93cdea875","Type":"ContainerStarted","Data":"f9e49d97ac5dcd384ead5e35beaf8eb4dfe2561b9a0742aabf3d2950ee423128"}
Jul 29 01:09:37.793353 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.793239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mrl6" event={"ID":"3580c323-cdef-46f3-b168-285944ce1d46","Type":"ContainerStarted","Data":"3f4c163d2a8e88cbc15324e4ac80983b8efb4c3d33fe31a80133c01444d7fd73"}
Jul 29 01:09:37.795897 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.795801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5jxs" event={"ID":"4ce56aef-1689-4ec9-b2bd-687357a6a87a","Type":"ContainerStarted","Data":"48423ce91912f68ef8c35db424729158917f760d580e400ef627259c350a9e60"}
Jul 29 01:09:37.821924 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.821867    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7mrl6" podStartSLOduration=3.102950241 podStartE2EDuration="21.821846795s" totalImagesPullingTime="18.718896554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:37.821273392 +0000 UTC m=+22.783270443" watchObservedRunningTime="2026-07-29 01:09:37.821846795 +0000 UTC m=+22.783843804"
Jul 29 01:09:37.835009 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.834888    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b5jxs" podStartSLOduration=7.235797017 podStartE2EDuration="21.834870237s" totalImagesPullingTime="14.59907322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:37.834501514 +0000 UTC m=+22.796498522" watchObservedRunningTime="2026-07-29 01:09:37.834870237 +0000 UTC m=+22.796867244"
Jul 29 01:09:37.867450 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.867252    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2vdwn" podStartSLOduration=3.055324849 podStartE2EDuration="21.867205974s" totalImagesPullingTime="18.811881125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:37.8667674 +0000 UTC m=+22.828764406" watchObservedRunningTime="2026-07-29 01:09:37.867205974 +0000 UTC m=+22.829202982"
Jul 29 01:09:37.891044 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.890989    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g7pms" podStartSLOduration=3.150659701 podStartE2EDuration="21.890974032s" totalImagesPullingTime="18.740314331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:37.890883912 +0000 UTC m=+22.852880924" watchObservedRunningTime="2026-07-29 01:09:37.890974032 +0000 UTC m=+22.852971039"
Jul 29 01:09:37.912384 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:37.912345    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4hggq" podStartSLOduration=3.206721532 podStartE2EDuration="21.912326669s" totalImagesPullingTime="18.705605137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:37.911869178 +0000 UTC m=+22.873866183" watchObservedRunningTime="2026-07-29 01:09:37.912326669 +0000 UTC m=+22.874323676"
Jul 29 01:09:38.799635 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.799597    2563 generic.go:356] "Generic (PLEG): container finished" podID="50bb53b8-c7b0-43de-8f1c-e7fc63e1351c" containerID="fb14a8a617ccb12a29858f8735a42b205d45f48dc4785e27538efdc930b2d8c9" exitCode=0
Jul 29 01:09:38.800650 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.799678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerDied","Data":"fb14a8a617ccb12a29858f8735a42b205d45f48dc4785e27538efdc930b2d8c9"}
Jul 29 01:09:38.802883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.802852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"dc50734f1bfdee39312af4ee95c101aa296c824d53544f56a3569cb2d2537dfa"}
Jul 29 01:09:38.802963 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.802926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"0d5b99eb0825ab6ae20fcd37241ffa87141ea3509227bd126903b02e690fe11d"}
Jul 29 01:09:38.802963 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.802957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"d624c66350e8e2e250eb75b7a8ae1319c7ea0f086cf791d6c6b2b6eff79f8ccb"}
Jul 29 01:09:38.803030 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.802994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"4e9fc4d1af8eddf4c3a42baadb58db0ccc02e592a1dc702a32ea56ddc82b1d85"}
Jul 29 01:09:38.803030 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:38.803025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"1d6eac8bcb611bcf0c04253ae0800bfec6a8a011b32cf4b82156cc788107c6b3"}
Jul 29 01:09:39.096372 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.096340    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:09:39.189119 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.189073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:39.539256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.539222    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:39.539453 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.539226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:39.539453 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:39.539352    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:39.539453 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.539369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:39.539611 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:39.539481    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:39.539611 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:39.539539    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:39.541227 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.541110    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:09:39.096359232Z","UUID":"a01fba0e-f11f-4372-8fe6-605ff79a8a6c","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:09:39.543003 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.542984    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:09:39.543132 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.543025    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:09:39.807483 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.807391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68" event={"ID":"a9ebe96a-1079-49a6-9e21-d765479a847b","Type":"ContainerStarted","Data":"421494d99d928f9c1a02e1b5a9d4ef7c91537430d8ca353446381370e75c94a6"}
Jul 29 01:09:39.809324 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.809292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8q48" event={"ID":"7609233a-7f8f-40c7-b409-80ff7bcfc480","Type":"ContainerStarted","Data":"37f67c7dbff2e3fbf527a7ef8457a80b54f02d0257e49ec6b80711a23089ed8d"}
Jul 29 01:09:39.823988 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:39.823933    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v8q48" podStartSLOduration=5.111737197 podStartE2EDuration="23.82391651s" totalImagesPullingTime="18.712179313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:39.823868239 +0000 UTC m=+24.785865248" watchObservedRunningTime="2026-07-29 01:09:39.82391651 +0000 UTC m=+24.785913517"
Jul 29 01:09:40.816032 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:40.815993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"d90d3d018379373e13f5b2d08e5b1d695811068a0c7ba97e518de57058842606"}
Jul 29 01:09:40.818819 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:40.818782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68" event={"ID":"a9ebe96a-1079-49a6-9e21-d765479a847b","Type":"ContainerStarted","Data":"9030f65ff8880313d518fd134afd8aea83f926347e931ed37bd129ed291f8b53"}
Jul 29 01:09:40.839771 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:40.839718    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfs68" podStartSLOduration=3.764239613 podStartE2EDuration="24.839702203s" totalImagesPullingTime="21.07546259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:40.839333989 +0000 UTC m=+25.801330996" watchObservedRunningTime="2026-07-29 01:09:40.839702203 +0000 UTC m=+25.801699207"
Jul 29 01:09:41.274107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:41.274063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:41.274838 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:41.274812    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:41.541372 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:41.541290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:41.541543 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:41.541395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:41.541543 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:41.541408    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:41.541543 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:41.541477    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:41.541543 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:41.541517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:41.541728 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:41.541564    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:41.822064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:41.821976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g7pms"
Jul 29 01:09:43.538535 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.538356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:43.539300 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.538353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:43.539300 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:43.538611    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:43.539300 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:43.538726    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:43.539300 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.538353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:43.539300 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:43.538829    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:43.827646 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.827612    2563 generic.go:356] "Generic (PLEG): container finished" podID="50bb53b8-c7b0-43de-8f1c-e7fc63e1351c" containerID="11f10a6d2a995ce12084db97222829064567a56054c739e2e0179a7e38d0b622" exitCode=0
Jul 29 01:09:43.827827 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.827694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerDied","Data":"11f10a6d2a995ce12084db97222829064567a56054c739e2e0179a7e38d0b622"}
Jul 29 01:09:43.831501 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.831477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" event={"ID":"111302ec-d28b-4bf8-afd1-90748433ee2f","Type":"ContainerStarted","Data":"53a4be5b8cfb2e887144bce6a0bf9edc86d234e15ba635b982cfaebf7e73eb51"}
Jul 29 01:09:43.831828 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.831815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:43.831897 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.831876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:43.831963 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.831925    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:43.848108 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.848083    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:43.848329 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.848202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:09:43.891459 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:43.891405    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g" podStartSLOduration=9.109706829 podStartE2EDuration="27.891388514s" totalImagesPullingTime="18.781681685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:43.890981326 +0000 UTC m=+28.852978334" watchObservedRunningTime="2026-07-29 01:09:43.891388514 +0000 UTC m=+28.853385540"
Jul 29 01:09:45.257715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.257499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2gbcw"]
Jul 29 01:09:45.258221 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.257881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:45.258221 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:45.258003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:45.260715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.260678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z4z76"]
Jul 29 01:09:45.260857 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.260843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:45.260999 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:45.260976    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:45.263137 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.263112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vnmpv"]
Jul 29 01:09:45.263256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.263242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:45.263375 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:45.263340    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:45.838322 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.838284    2563 generic.go:356] "Generic (PLEG): container finished" podID="50bb53b8-c7b0-43de-8f1c-e7fc63e1351c" containerID="cf1e9025b6d48ad9b328463c7e146870558be51542fa48de2de756423cfa3424" exitCode=0
Jul 29 01:09:45.838524 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:45.838369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerDied","Data":"cf1e9025b6d48ad9b328463c7e146870558be51542fa48de2de756423cfa3424"}
Jul 29 01:09:46.539132 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:46.539101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:46.539586 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:46.539101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:46.539586 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:46.539251    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:46.539586 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:46.539315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:47.538722 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:47.538645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:47.538852 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:47.538757    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:47.845690 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:47.845608    2563 generic.go:356] "Generic (PLEG): container finished" podID="50bb53b8-c7b0-43de-8f1c-e7fc63e1351c" containerID="facf8a573c4b09888e882a4aff6600061e942d3565a6b29703c2d7a5b7bd0a63" exitCode=0
Jul 29 01:09:47.845690 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:47.845661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerDied","Data":"facf8a573c4b09888e882a4aff6600061e942d3565a6b29703c2d7a5b7bd0a63"}
Jul 29 01:09:48.538422 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:48.538386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:48.538596 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:48.538386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:48.538596 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:48.538503    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vnmpv" podUID="bfcae055-8647-448a-bcb0-723e2c0ccf89"
Jul 29 01:09:48.538672 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:48.538596    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2gbcw" podUID="28a2b89c-1ac3-4a6f-93aa-1d76e603286d"
Jul 29 01:09:49.235753 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:49.235492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:49.235753 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.235687    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:49.236281 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.235771    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:10:21.235748449 +0000 UTC m=+66.197745439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:49.336424 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:49.336384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:49.336439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.336537    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.336553    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.336570    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.336583    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f8bvb for pod openshift-network-diagnostics/network-check-target-vnmpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.336603    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret podName:28a2b89c-1ac3-4a6f-93aa-1d76e603286d nodeName:}" failed. No retries permitted until 2026-07-29 01:10:21.336584571 +0000 UTC m=+66.298581577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret") pod "global-pull-secret-syncer-2gbcw" (UID: "28a2b89c-1ac3-4a6f-93aa-1d76e603286d") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:49.336618 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.336621    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb podName:bfcae055-8647-448a-bcb0-723e2c0ccf89 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:21.336612799 +0000 UTC m=+66.298609784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8bvb" (UniqueName: "kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb") pod "network-check-target-vnmpv" (UID: "bfcae055-8647-448a-bcb0-723e2c0ccf89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:49.538563 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:49.538427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:49.538847 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:49.538623    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:09:50.381773 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.381745    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeReady"
Jul 29 01:09:50.382233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.381906    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:09:50.416256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.416210    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-597h6"]
Jul 29 01:09:50.422240 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.422206    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"]
Jul 29 01:09:50.422407 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.422327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:50.425155 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.425126    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 01:09:50.427995 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.425662    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ch94d\""
Jul 29 01:09:50.427995 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.425676    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 01:09:50.429962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.429508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.429962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.429656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-597h6"]
Jul 29 01:09:50.431931 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.431749    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lfkw5\""
Jul 29 01:09:50.431931 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.431803    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 01:09:50.432270 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.432249    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tlrfb"]
Jul 29 01:09:50.432619 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.432598    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 01:09:50.432832 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.432814    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 01:09:50.436619 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.436599    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.438882 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.438862    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 01:09:50.439310 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.439280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"]
Jul 29 01:09:50.440122 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.440101    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z64kk"]
Jul 29 01:09:50.440616 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.440594    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:09:50.440734 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.440683    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:09:50.440931 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.440913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:09:50.441142 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.441124    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fcjh7\""
Jul 29 01:09:50.444035 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.444006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.446516 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.446494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tlrfb"]
Jul 29 01:09:50.447658 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.447633    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:09:50.447742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.447677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:09:50.447808 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.447638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zd58l\""
Jul 29 01:09:50.453293 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.453265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z64kk"]
Jul 29 01:09:50.538360 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.538328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:09:50.538551 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.538370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:09:50.540832 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.540784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:09:50.540962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.540834    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jbq7\""
Jul 29 01:09:50.541145 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.541130    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:09:50.541238 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.541128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:09:50.544619 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.544785 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8962e9cc-2da2-494b-b328-f64b0fb90b81-cert\") pod \"ingress-canary-tlrfb\" (UID: \"8962e9cc-2da2-494b-b328-f64b0fb90b81\") " pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.544785 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzvbj\" (UniqueName: \"kubernetes.io/projected/8962e9cc-2da2-494b-b328-f64b0fb90b81-kube-api-access-gzvbj\") pod \"ingress-canary-tlrfb\" (UID: \"8962e9cc-2da2-494b-b328-f64b0fb90b81\") " pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.544785 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrst\" (UniqueName: \"kubernetes.io/projected/dac8e08e-8f19-430f-b101-a08c3259fc5a-kube-api-access-zdrst\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.544962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-image-registry-private-configuration\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.544962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:50.544962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-certificates\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.544962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dac8e08e-8f19-430f-b101-a08c3259fc5a-config-volume\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.544962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac8e08e-8f19-430f-b101-a08c3259fc5a-tmp-dir\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.544962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-ca-trust-extracted\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.545255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.544984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-trusted-ca\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.545255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.545008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-bound-sa-token\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.545255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.545061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-installation-pull-secrets\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.545255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.545134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.545255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.545169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmvj\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-kube-api-access-2gmvj\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.545255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.545238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a7ffbea-57e3-49a4-8c7c-686251a9111e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:50.583666 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.583626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7pms_e08ee925-2bdf-440b-b76f-189cebc8b23f/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:50.646092 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-installation-pull-secrets\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646092 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646092 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmvj\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-kube-api-access-2gmvj\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a7ffbea-57e3-49a4-8c7c-686251a9111e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8962e9cc-2da2-494b-b328-f64b0fb90b81-cert\") pod \"ingress-canary-tlrfb\" (UID: \"8962e9cc-2da2-494b-b328-f64b0fb90b81\") " pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.646169    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzvbj\" (UniqueName: \"kubernetes.io/projected/8962e9cc-2da2-494b-b328-f64b0fb90b81-kube-api-access-gzvbj\") pod \"ingress-canary-tlrfb\" (UID: \"8962e9cc-2da2-494b-b328-f64b0fb90b81\") " pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrst\" (UniqueName: \"kubernetes.io/projected/dac8e08e-8f19-430f-b101-a08c3259fc5a-kube-api-access-zdrst\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-image-registry-private-configuration\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-certificates\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dac8e08e-8f19-430f-b101-a08c3259fc5a-config-volume\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.646841 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac8e08e-8f19-430f-b101-a08c3259fc5a-tmp-dir\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.646841 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-ca-trust-extracted\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646841 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-trusted-ca\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646841 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-bound-sa-token\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.646841 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.646212    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:09:50.647080 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.646887    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:51.146860603 +0000 UTC m=+36.108857588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:09:50.647080 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.646924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a7ffbea-57e3-49a4-8c7c-686251a9111e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:50.647080 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.646928    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:09:50.647080 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.647015    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:09:51.146999054 +0000 UTC m=+36.108996050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:09:50.647080 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.647048    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:09:50.647363 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:50.647107    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:09:51.147082316 +0000 UTC m=+36.109079302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:09:50.648021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.647495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-ca-trust-extracted\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.648021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.647518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac8e08e-8f19-430f-b101-a08c3259fc5a-tmp-dir\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.648021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.647538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-certificates\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.648021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.647980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dac8e08e-8f19-430f-b101-a08c3259fc5a-config-volume\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.648716 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.648691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-trusted-ca\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.651716 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.651693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8962e9cc-2da2-494b-b328-f64b0fb90b81-cert\") pod \"ingress-canary-tlrfb\" (UID: \"8962e9cc-2da2-494b-b328-f64b0fb90b81\") " pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.651815 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.651694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-image-registry-private-configuration\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.651815 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.651756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-installation-pull-secrets\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.655554 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.655530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-bound-sa-token\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.656057 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.656039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrst\" (UniqueName: \"kubernetes.io/projected/dac8e08e-8f19-430f-b101-a08c3259fc5a-kube-api-access-zdrst\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:50.656119 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.656063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmvj\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-kube-api-access-2gmvj\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:50.656158 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.656132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzvbj\" (UniqueName: \"kubernetes.io/projected/8962e9cc-2da2-494b-b328-f64b0fb90b81-kube-api-access-gzvbj\") pod \"ingress-canary-tlrfb\" (UID: \"8962e9cc-2da2-494b-b328-f64b0fb90b81\") " pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.665110 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.665036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7pms_e08ee925-2bdf-440b-b76f-189cebc8b23f/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:50.759236 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.759203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tlrfb"
Jul 29 01:09:50.866506 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.866474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7pms_e08ee925-2bdf-440b-b76f-189cebc8b23f/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:50.951046 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:50.950950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7pms_e08ee925-2bdf-440b-b76f-189cebc8b23f/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:51.150526 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.150477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:51.150732 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.150598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:51.150732 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.150629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:51.150732 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.150641    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:09:51.153156 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.151042    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:09:52.151013021 +0000 UTC m=+37.113010037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:09:51.153156 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.151085    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:09:51.153156 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.151102    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:09:51.153156 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.151128    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:09:51.153156 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.151165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:09:52.151150289 +0000 UTC m=+37.113147288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:09:51.153156 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:51.151222    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:52.151203978 +0000 UTC m=+37.113200978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:09:51.543177 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.543142    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:09:51.545930 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.545904    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:09:51.546057 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.545948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2784\""
Jul 29 01:09:51.760051 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.760018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g7pms_e08ee925-2bdf-440b-b76f-189cebc8b23f/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:51.880834 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:51.880530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tlrfb"]
Jul 29 01:09:51.883559 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:09:51.883530    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8962e9cc_2da2_494b_b328_f64b0fb90b81.slice/crio-9d2c18bb85d989bd806989495925a57f47c4970dea79c5b4360fe29dbd4e6e01 WatchSource:0}: Error finding container 9d2c18bb85d989bd806989495925a57f47c4970dea79c5b4360fe29dbd4e6e01: Status 404 returned error can't find the container with id 9d2c18bb85d989bd806989495925a57f47c4970dea79c5b4360fe29dbd4e6e01
Jul 29 01:09:52.157492 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:52.157451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:52.157492 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:52.157498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:52.157549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157614    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157635    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157666    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157686    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:54.157669076 +0000 UTC m=+39.119666060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157696    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157710    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:09:54.157698236 +0000 UTC m=+39.119695224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:09:52.157755 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:52.157739    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:09:54.157725721 +0000 UTC m=+39.119722714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:09:52.862446 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:52.862411    2563 generic.go:356] "Generic (PLEG): container finished" podID="50bb53b8-c7b0-43de-8f1c-e7fc63e1351c" containerID="0af5e1010bc5884d2a0cd1d11b136b19d03ab7fa0ac642b344bb0e5ca1996462" exitCode=0
Jul 29 01:09:52.863119 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:52.862488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerDied","Data":"0af5e1010bc5884d2a0cd1d11b136b19d03ab7fa0ac642b344bb0e5ca1996462"}
Jul 29 01:09:52.863813 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:52.863775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tlrfb" event={"ID":"8962e9cc-2da2-494b-b328-f64b0fb90b81","Type":"ContainerStarted","Data":"9d2c18bb85d989bd806989495925a57f47c4970dea79c5b4360fe29dbd4e6e01"}
Jul 29 01:09:53.870870 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:53.870795    2563 generic.go:356] "Generic (PLEG): container finished" podID="50bb53b8-c7b0-43de-8f1c-e7fc63e1351c" containerID="997f765c4fd15359129f0b83a460065f050af76dd72bc89a84e51f1d09c85f9d" exitCode=0
Jul 29 01:09:53.870870 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:53.870827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerDied","Data":"997f765c4fd15359129f0b83a460065f050af76dd72bc89a84e51f1d09c85f9d"}
Jul 29 01:09:54.174421 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:54.174383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:54.174616 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:54.174433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:54.174616 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:54.174487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:54.174616 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174557    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:09:54.174616 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174582    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:09:54.174786 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174623    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:09:54.174786 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174643    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:09:54.174786 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174654    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:58.174632135 +0000 UTC m=+43.136629124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:09:54.174786 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174690    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:09:58.174671901 +0000 UTC m=+43.136668899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:09:54.174786 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:54.174714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:09:58.174703552 +0000 UTC m=+43.136700538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:09:54.875125 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:54.874931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tlrfb" event={"ID":"8962e9cc-2da2-494b-b328-f64b0fb90b81","Type":"ContainerStarted","Data":"3455ad4934e0e65d9bf42e294da26b1c43eb971356357cad856b7d1f4ee4e2ab"}
Jul 29 01:09:54.878676 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:54.878644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" event={"ID":"50bb53b8-c7b0-43de-8f1c-e7fc63e1351c","Type":"ContainerStarted","Data":"d5d7df05b19902b8f0588dbca4418add1ff6ad9ee196d39735712ceb2274c5cf"}
Jul 29 01:09:54.900622 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:54.900565    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s9fc8" podStartSLOduration=9.759528645 podStartE2EDuration="38.900547568s" totalImagesPullingTime="29.141018923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:54.899163558 +0000 UTC m=+39.861160566" watchObservedRunningTime="2026-07-29 01:09:54.900547568 +0000 UTC m=+39.862544574"
Jul 29 01:09:55.896775 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:55.896672    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tlrfb" podStartSLOduration=3.031196378 podStartE2EDuration="5.896656669s" totalImagesPullingTime="2.865460291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:55.896359139 +0000 UTC m=+40.858356147" watchObservedRunningTime="2026-07-29 01:09:55.896656669 +0000 UTC m=+40.858653675"
Jul 29 01:09:58.205122 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:58.205077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:58.205145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:09:58.205256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205271    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205340    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:10:06.205324023 +0000 UTC m=+51.167321011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205271    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205371    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205385    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:06.20537227 +0000 UTC m=+51.167369258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:09:58.205625 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:09:58.205451    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:06.205434984 +0000 UTC m=+51.167431974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:10:06.264881 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:06.264832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:10:06.264881 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:06.264890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:06.264938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265031    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265045    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265091    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265105    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:22.265089385 +0000 UTC m=+67.227086374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:22.265144707 +0000 UTC m=+67.227141707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265226    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:06.265473 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:06.265332    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:10:22.265316414 +0000 UTC m=+67.227313399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:15.853802 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:15.853770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc64g"
Jul 29 01:10:21.274359 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.274308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:10:21.277406 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.277381    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:10:21.285273 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:21.285240    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:10:21.285349 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:21.285338    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:11:25.285319151 +0000 UTC m=+130.247316136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : secret "metrics-daemon-secret" not found
Jul 29 01:10:21.375017 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.374981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:10:21.375153 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.375040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:10:21.377697 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.377669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:10:21.377697 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.377690    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:10:21.387403 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.387374    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:10:21.389248 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.389228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28a2b89c-1ac3-4a6f-93aa-1d76e603286d-original-pull-secret\") pod \"global-pull-secret-syncer-2gbcw\" (UID: \"28a2b89c-1ac3-4a6f-93aa-1d76e603286d\") " pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:10:21.398542 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.398516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8bvb\" (UniqueName: \"kubernetes.io/projected/bfcae055-8647-448a-bcb0-723e2c0ccf89-kube-api-access-f8bvb\") pod \"network-check-target-vnmpv\" (UID: \"bfcae055-8647-448a-bcb0-723e2c0ccf89\") " pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:10:21.452676 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.452636    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jbq7\""
Jul 29 01:10:21.456455 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.456433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2gbcw"
Jul 29 01:10:21.460117 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.460102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:10:21.597043 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.597010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vnmpv"]
Jul 29 01:10:21.601386 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:10:21.601357    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcae055_8647_448a_bcb0_723e2c0ccf89.slice/crio-b92f05a2f0e4c8aa80b4ee8809064d88f9f55b6eece40628d7d6824cf966f9b2 WatchSource:0}: Error finding container b92f05a2f0e4c8aa80b4ee8809064d88f9f55b6eece40628d7d6824cf966f9b2: Status 404 returned error can't find the container with id b92f05a2f0e4c8aa80b4ee8809064d88f9f55b6eece40628d7d6824cf966f9b2
Jul 29 01:10:21.612627 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.612596    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2gbcw"]
Jul 29 01:10:21.615815 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:10:21.615793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a2b89c_1ac3_4a6f_93aa_1d76e603286d.slice/crio-faf53dacff489644196c73cc4edc4575c99190dd2fd572119f6bfc9e90f8efc0 WatchSource:0}: Error finding container faf53dacff489644196c73cc4edc4575c99190dd2fd572119f6bfc9e90f8efc0: Status 404 returned error can't find the container with id faf53dacff489644196c73cc4edc4575c99190dd2fd572119f6bfc9e90f8efc0
Jul 29 01:10:21.941531 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.941489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vnmpv" event={"ID":"bfcae055-8647-448a-bcb0-723e2c0ccf89","Type":"ContainerStarted","Data":"b92f05a2f0e4c8aa80b4ee8809064d88f9f55b6eece40628d7d6824cf966f9b2"}
Jul 29 01:10:21.942720 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:21.942685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2gbcw" event={"ID":"28a2b89c-1ac3-4a6f-93aa-1d76e603286d","Type":"ContainerStarted","Data":"faf53dacff489644196c73cc4edc4575c99190dd2fd572119f6bfc9e90f8efc0"}
Jul 29 01:10:22.281845 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:22.281759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:10:22.281845 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:22.281809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.281928    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.281937    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.281960    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.281989    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:10:54.281972559 +0000 UTC m=+99.243969545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.282014    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:54.281995283 +0000 UTC m=+99.243992281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:22.282037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.282166    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:22.282359 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:22.282233    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:10:54.282219401 +0000 UTC m=+99.244216389 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:26.958115 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:26.958076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vnmpv" event={"ID":"bfcae055-8647-448a-bcb0-723e2c0ccf89","Type":"ContainerStarted","Data":"9794ffea3c09c103c8abfa7f429e1e1a203918a620ba913b9f4bbe2659323a95"}
Jul 29 01:10:26.958571 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:26.958175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:10:26.959592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:26.959565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2gbcw" event={"ID":"28a2b89c-1ac3-4a6f-93aa-1d76e603286d","Type":"ContainerStarted","Data":"764a2e7da704f2d08be0a96192d3e79c563633bb7719c97c216423469eb08257"}
Jul 29 01:10:26.973398 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:26.973352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vnmpv" podStartSLOduration=65.959724833 podStartE2EDuration="1m10.973336585s" totalImagesPullingTime="5.013611752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:26.972516383 +0000 UTC m=+71.934513390" watchObservedRunningTime="2026-07-29 01:10:26.973336585 +0000 UTC m=+71.935333582"
Jul 29 01:10:26.985370 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:26.985330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2gbcw" podStartSLOduration=65.972687992 podStartE2EDuration="1m10.985313815s" totalImagesPullingTime="5.012625823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:26.985283035 +0000 UTC m=+71.947280055" watchObservedRunningTime="2026-07-29 01:10:26.985313815 +0000 UTC m=+71.947310805"
Jul 29 01:10:54.321428 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:54.321284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:10:54.321428 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:54.321337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:10:54.321428 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:54.321395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321464    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321483    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321493    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321511    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321552    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:58.321536402 +0000 UTC m=+163.283533388 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321566    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:58.321560395 +0000 UTC m=+163.283557379 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:54.322002 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:10:54.321576    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:11:58.32157086 +0000 UTC m=+163.283567846 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:10:57.964319 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:10:57.964284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vnmpv"
Jul 29 01:11:25.349373 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:25.349323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:11:25.349880 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:25.349495    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:11:25.349880 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:25.349578    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.349560518 +0000 UTC m=+252.311557506 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : secret "metrics-daemon-secret" not found
Jul 29 01:11:53.440476 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:53.440422    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6" podUID="6a7ffbea-57e3-49a4-8c7c-686251a9111e"
Jul 29 01:11:53.450581 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:53.450548    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75"
Jul 29 01:11:53.463866 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:53.463836    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z64kk" podUID="dac8e08e-8f19-430f-b101-a08c3259fc5a"
Jul 29 01:11:54.166247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:54.166217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z64kk"
Jul 29 01:11:54.166424 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:54.166217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:11:54.166424 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:54.166217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:11:54.554357 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:54.554261    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:11:58.396411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:58.396365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:58.396418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:11:58.396450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396543    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396603    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert podName:6a7ffbea-57e3-49a4-8c7c-686251a9111e nodeName:}" failed. No retries permitted until 2026-07-29 01:14:00.396588182 +0000 UTC m=+285.358585168 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-597h6" (UID: "6a7ffbea-57e3-49a4-8c7c-686251a9111e") : secret "networking-console-plugin-cert" not found
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396608    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396541    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396705    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bcb5c66fc-8fz2f: secret "image-registry-tls" not found
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396692    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls podName:dac8e08e-8f19-430f-b101-a08c3259fc5a nodeName:}" failed. No retries permitted until 2026-07-29 01:14:00.396671357 +0000 UTC m=+285.358668360 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls") pod "dns-default-z64kk" (UID: "dac8e08e-8f19-430f-b101-a08c3259fc5a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:58.396969 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:11:58.396765    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls podName:4c7a5ab5-7b89-4a33-8191-6054ffb58d75 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:00.396749796 +0000 UTC m=+285.358746783 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls") pod "image-registry-5bcb5c66fc-8fz2f" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75") : secret "image-registry-tls" not found
Jul 29 01:12:08.538277 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:12:08.538238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:13:22.544321 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.544284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"]
Jul 29 01:13:22.547036 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.547020    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.551407 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.551385    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-j6h2q"]
Jul 29 01:13:22.551508 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.551410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-84dcz\""
Jul 29 01:13:22.551969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.551935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.552052 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.552013    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.552114 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.552019    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 01:13:22.552114 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.552098    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 01:13:22.554085 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.554062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.556539 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.556521    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.556539 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.556531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 01:13:22.556688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.556527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.556688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.556570    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 01:13:22.556688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.556533    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rvlmn\""
Jul 29 01:13:22.563771 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.563742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 01:13:22.564459 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.564437    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"]
Jul 29 01:13:22.567873 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.567854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-j6h2q"]
Jul 29 01:13:22.580345 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-serving-cert\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.580437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-tmp\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.580437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-snapshots\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.580437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds2tn\" (UniqueName: \"kubernetes.io/projected/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-kube-api-access-ds2tn\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.580548 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.580548 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93314bb5-d56d-4077-bccc-e9a739d7ef10-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.580617 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93314bb5-d56d-4077-bccc-e9a739d7ef10-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.580617 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2gz\" (UniqueName: \"kubernetes.io/projected/93314bb5-d56d-4077-bccc-e9a739d7ef10-kube-api-access-lc2gz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.580617 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.580604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-service-ca-bundle\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.639387 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.639357    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"]
Jul 29 01:13:22.642173 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.642153    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"]
Jul 29 01:13:22.642298 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.642276    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"
Jul 29 01:13:22.645008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.644987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:22.645278 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.645209    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m5cwg\""
Jul 29 01:13:22.645390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.645353    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"]
Jul 29 01:13:22.648000 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.647980    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-j4vgn"]
Jul 29 01:13:22.648121 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.648106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"
Jul 29 01:13:22.649858 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.649841    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 01:13:22.650086 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.650067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.650222 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.650139    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cmz9w\""
Jul 29 01:13:22.650750 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.650733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.651098 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.651078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"]
Jul 29 01:13:22.651500 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.651485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.653547 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.653530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.653642 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.653604    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.654473 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.654456    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 01:13:22.655358 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.655310    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kzrwr\""
Jul 29 01:13:22.655358 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.655349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.655547 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.655531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 01:13:22.656363 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.656343    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5pm67\""
Jul 29 01:13:22.657371 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.657349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.661816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.661795    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 01:13:22.662053 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.662036    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"]
Jul 29 01:13:22.667249 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.667229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"]
Jul 29 01:13:22.681694 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztw7x\" (UniqueName: \"kubernetes.io/projected/4b3f991a-542d-46dd-a018-ff5ad006f45f-kube-api-access-ztw7x\") pod \"volume-data-source-validator-549c6d54cf-d6ltf\" (UID: \"4b3f991a-542d-46dd-a018-ff5ad006f45f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"
Jul 29 01:13:22.681823 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-tmp\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.681823 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dea64566-9623-486c-9232-8237e03de953-serving-cert\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.681823 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dea64566-9623-486c-9232-8237e03de953-trusted-ca\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.681993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.681993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93314bb5-d56d-4077-bccc-e9a739d7ef10-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.681993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93314bb5-d56d-4077-bccc-e9a739d7ef10-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.681993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-serving-cert\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.681993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dea64566-9623-486c-9232-8237e03de953-config\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.681993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-snapshots\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85g7p\" (UniqueName: \"kubernetes.io/projected/bdf4399e-87ad-4081-aaf9-ac04cc4af403-kube-api-access-85g7p\") pod \"network-check-source-7d88cb55d8-2hvf8\" (UID: \"bdf4399e-87ad-4081-aaf9-ac04cc4af403\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqvgk\" (UniqueName: \"kubernetes.io/projected/872e64d9-f33e-4661-a71a-80c56957f536-kube-api-access-kqvgk\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds2tn\" (UniqueName: \"kubernetes.io/projected/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-kube-api-access-ds2tn\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-tmp\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2gz\" (UniqueName: \"kubernetes.io/projected/93314bb5-d56d-4077-bccc-e9a739d7ef10-kube-api-access-lc2gz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.682256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt4qt\" (UniqueName: \"kubernetes.io/projected/dea64566-9623-486c-9232-8237e03de953-kube-api-access-vt4qt\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.682656 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.682266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-service-ca-bundle\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.683112 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.683085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-snapshots\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.688399 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.683904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93314bb5-d56d-4077-bccc-e9a739d7ef10-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.688399 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.683940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.688399 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.685373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-j4vgn"]
Jul 29 01:13:22.688399 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.686345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93314bb5-d56d-4077-bccc-e9a739d7ef10-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.688662 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.688523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-service-ca-bundle\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.689509 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.689488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-serving-cert\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.698910 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.698886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds2tn\" (UniqueName: \"kubernetes.io/projected/8be3f6c9-65ba-4488-ad8f-776a8fc702c7-kube-api-access-ds2tn\") pod \"insights-operator-5885fdb759-j6h2q\" (UID: \"8be3f6c9-65ba-4488-ad8f-776a8fc702c7\") " pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.699000 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.698978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2gz\" (UniqueName: \"kubernetes.io/projected/93314bb5-d56d-4077-bccc-e9a739d7ef10-kube-api-access-lc2gz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft\" (UID: \"93314bb5-d56d-4077-bccc-e9a739d7ef10\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.783536 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt4qt\" (UniqueName: \"kubernetes.io/projected/dea64566-9623-486c-9232-8237e03de953-kube-api-access-vt4qt\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.783718 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw7x\" (UniqueName: \"kubernetes.io/projected/4b3f991a-542d-46dd-a018-ff5ad006f45f-kube-api-access-ztw7x\") pod \"volume-data-source-validator-549c6d54cf-d6ltf\" (UID: \"4b3f991a-542d-46dd-a018-ff5ad006f45f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"
Jul 29 01:13:22.783718 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dea64566-9623-486c-9232-8237e03de953-serving-cert\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.783718 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dea64566-9623-486c-9232-8237e03de953-trusted-ca\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.783718 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dea64566-9623-486c-9232-8237e03de953-config\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.783918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85g7p\" (UniqueName: \"kubernetes.io/projected/bdf4399e-87ad-4081-aaf9-ac04cc4af403-kube-api-access-85g7p\") pod \"network-check-source-7d88cb55d8-2hvf8\" (UID: \"bdf4399e-87ad-4081-aaf9-ac04cc4af403\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"
Jul 29 01:13:22.783918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqvgk\" (UniqueName: \"kubernetes.io/projected/872e64d9-f33e-4661-a71a-80c56957f536-kube-api-access-kqvgk\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:22.783918 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.783890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:22.784111 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:22.783955    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:13:22.784111 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:22.784020    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls podName:872e64d9-f33e-4661-a71a-80c56957f536 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:23.283998589 +0000 UTC m=+248.245995595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls") pod "cluster-samples-operator-6748489656-lkncw" (UID: "872e64d9-f33e-4661-a71a-80c56957f536") : secret "samples-operator-tls" not found
Jul 29 01:13:22.784506 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.784489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dea64566-9623-486c-9232-8237e03de953-config\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.784561 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.784501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dea64566-9623-486c-9232-8237e03de953-trusted-ca\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.786561 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.786538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dea64566-9623-486c-9232-8237e03de953-serving-cert\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.796704 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.796656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt4qt\" (UniqueName: \"kubernetes.io/projected/dea64566-9623-486c-9232-8237e03de953-kube-api-access-vt4qt\") pod \"console-operator-584dcb6b54-j4vgn\" (UID: \"dea64566-9623-486c-9232-8237e03de953\") " pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.796799 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.796743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw7x\" (UniqueName: \"kubernetes.io/projected/4b3f991a-542d-46dd-a018-ff5ad006f45f-kube-api-access-ztw7x\") pod \"volume-data-source-validator-549c6d54cf-d6ltf\" (UID: \"4b3f991a-542d-46dd-a018-ff5ad006f45f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"
Jul 29 01:13:22.796851 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.796813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85g7p\" (UniqueName: \"kubernetes.io/projected/bdf4399e-87ad-4081-aaf9-ac04cc4af403-kube-api-access-85g7p\") pod \"network-check-source-7d88cb55d8-2hvf8\" (UID: \"bdf4399e-87ad-4081-aaf9-ac04cc4af403\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"
Jul 29 01:13:22.797327 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.797310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqvgk\" (UniqueName: \"kubernetes.io/projected/872e64d9-f33e-4661-a71a-80c56957f536-kube-api-access-kqvgk\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:22.856740 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.856708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"
Jul 29 01:13:22.863848 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.863826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-j6h2q"
Jul 29 01:13:22.952892 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.952677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"
Jul 29 01:13:22.968390 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.968365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"
Jul 29 01:13:22.973964 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.973941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:22.982175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:22.982153    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft"]
Jul 29 01:13:22.985958 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:22.985874    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93314bb5_d56d_4077_bccc_e9a739d7ef10.slice/crio-8805bb8d632b2f466bcab331ff2d42c1152d26bdcae4c8045c8f8e0cc3f0fa67 WatchSource:0}: Error finding container 8805bb8d632b2f466bcab331ff2d42c1152d26bdcae4c8045c8f8e0cc3f0fa67: Status 404 returned error can't find the container with id 8805bb8d632b2f466bcab331ff2d42c1152d26bdcae4c8045c8f8e0cc3f0fa67
Jul 29 01:13:23.005462 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.005341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-j6h2q"]
Jul 29 01:13:23.095217 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.095170    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8"]
Jul 29 01:13:23.099005 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:23.098967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf4399e_87ad_4081_aaf9_ac04cc4af403.slice/crio-69ffb16a7a44aa9e5832d738352496f655ca3c939e80210ec27e25e31e81f0cb WatchSource:0}: Error finding container 69ffb16a7a44aa9e5832d738352496f655ca3c939e80210ec27e25e31e81f0cb: Status 404 returned error can't find the container with id 69ffb16a7a44aa9e5832d738352496f655ca3c939e80210ec27e25e31e81f0cb
Jul 29 01:13:23.117263 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.117236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf"]
Jul 29 01:13:23.127170 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:23.127143    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3f991a_542d_46dd_a018_ff5ad006f45f.slice/crio-99280e8d9422a96f3fa1d51989241e47c9082e14c88d08cf295501c0f22cedf7 WatchSource:0}: Error finding container 99280e8d9422a96f3fa1d51989241e47c9082e14c88d08cf295501c0f22cedf7: Status 404 returned error can't find the container with id 99280e8d9422a96f3fa1d51989241e47c9082e14c88d08cf295501c0f22cedf7
Jul 29 01:13:23.149164 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.149134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-j4vgn"]
Jul 29 01:13:23.153761 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:23.153728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea64566_9623_486c_9232_8237e03de953.slice/crio-7ce52218a08cf32abd52a4a187c70e85503586a9f6cf500d28e3759d6692144e WatchSource:0}: Error finding container 7ce52218a08cf32abd52a4a187c70e85503586a9f6cf500d28e3759d6692144e: Status 404 returned error can't find the container with id 7ce52218a08cf32abd52a4a187c70e85503586a9f6cf500d28e3759d6692144e
Jul 29 01:13:23.287375 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.287337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:23.287558 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:23.287501    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:13:23.287596 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:23.287566    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls podName:872e64d9-f33e-4661-a71a-80c56957f536 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:24.287549134 +0000 UTC m=+249.249546120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls") pod "cluster-samples-operator-6748489656-lkncw" (UID: "872e64d9-f33e-4661-a71a-80c56957f536") : secret "samples-operator-tls" not found
Jul 29 01:13:23.378240 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.378202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" event={"ID":"dea64566-9623-486c-9232-8237e03de953","Type":"ContainerStarted","Data":"7ce52218a08cf32abd52a4a187c70e85503586a9f6cf500d28e3759d6692144e"}
Jul 29 01:13:23.379328 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.379303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft" event={"ID":"93314bb5-d56d-4077-bccc-e9a739d7ef10","Type":"ContainerStarted","Data":"8805bb8d632b2f466bcab331ff2d42c1152d26bdcae4c8045c8f8e0cc3f0fa67"}
Jul 29 01:13:23.380666 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.380641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j6h2q" event={"ID":"8be3f6c9-65ba-4488-ad8f-776a8fc702c7","Type":"ContainerStarted","Data":"3566c4089d361f92850f2fa9183b3d292e451b996025b157e53022e01fc3b12f"}
Jul 29 01:13:23.381705 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.381683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf" event={"ID":"4b3f991a-542d-46dd-a018-ff5ad006f45f","Type":"ContainerStarted","Data":"99280e8d9422a96f3fa1d51989241e47c9082e14c88d08cf295501c0f22cedf7"}
Jul 29 01:13:23.383060 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.383039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8" event={"ID":"bdf4399e-87ad-4081-aaf9-ac04cc4af403","Type":"ContainerStarted","Data":"9f4c41512372288c241c153a6893efa93b40602e24c5e4d315e0a91ab6f14e7e"}
Jul 29 01:13:23.383146 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.383072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8" event={"ID":"bdf4399e-87ad-4081-aaf9-ac04cc4af403","Type":"ContainerStarted","Data":"69ffb16a7a44aa9e5832d738352496f655ca3c939e80210ec27e25e31e81f0cb"}
Jul 29 01:13:23.398727 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:23.398551    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2hvf8" podStartSLOduration=1.398533746 podStartE2EDuration="1.398533746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:23.398073751 +0000 UTC m=+248.360070758" watchObservedRunningTime="2026-07-29 01:13:23.398533746 +0000 UTC m=+248.360530753"
Jul 29 01:13:24.298499 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:24.297885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:24.298499 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:24.298050    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:13:24.298499 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:24.298116    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls podName:872e64d9-f33e-4661-a71a-80c56957f536 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:26.298095605 +0000 UTC m=+251.260092590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls") pod "cluster-samples-operator-6748489656-lkncw" (UID: "872e64d9-f33e-4661-a71a-80c56957f536") : secret "samples-operator-tls" not found
Jul 29 01:13:25.390600 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:25.390554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf" event={"ID":"4b3f991a-542d-46dd-a018-ff5ad006f45f","Type":"ContainerStarted","Data":"664a5af546bc7033f485a569b4ac33b6839f5c05a52c629fde53a7fee30ac87a"}
Jul 29 01:13:25.405603 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:25.405419    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-d6ltf" podStartSLOduration=2.033388827 podStartE2EDuration="3.405398472s" totalImagesPullingTime="1.372009645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:25.404803056 +0000 UTC m=+250.366800065" watchObservedRunningTime="2026-07-29 01:13:25.405398472 +0000 UTC m=+250.367395484"
Jul 29 01:13:26.320080 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.320048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:26.320242 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:26.320223    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:13:26.320374 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:26.320288    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls podName:872e64d9-f33e-4661-a71a-80c56957f536 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.320269331 +0000 UTC m=+255.282266318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls") pod "cluster-samples-operator-6748489656-lkncw" (UID: "872e64d9-f33e-4661-a71a-80c56957f536") : secret "samples-operator-tls" not found
Jul 29 01:13:26.396291 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.396233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" event={"ID":"dea64566-9623-486c-9232-8237e03de953","Type":"ContainerStarted","Data":"1f151d8102f6c062fd1721582e70e39d133ab3fd8e95cba8443145cd82f1f6f3"}
Jul 29 01:13:26.397008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.396984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:26.398259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.398231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft" event={"ID":"93314bb5-d56d-4077-bccc-e9a739d7ef10","Type":"ContainerStarted","Data":"6001f27f76fd76d7d26bcca2be70e255c9a84b0477e2c30008f1a41de6c3ce27"}
Jul 29 01:13:26.398472 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.398265    2563 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-j4vgn container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body=
Jul 29 01:13:26.398625 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.398596    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" podUID="dea64566-9623-486c-9232-8237e03de953" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused"
Jul 29 01:13:26.400280 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.400255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j6h2q" event={"ID":"8be3f6c9-65ba-4488-ad8f-776a8fc702c7","Type":"ContainerStarted","Data":"25446731c8cc111d1c4503a2ec17c90020038d08317288c81bfa084a47f58917"}
Jul 29 01:13:26.413529 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.413450    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" podStartSLOduration=1.258617795 podStartE2EDuration="4.413413843s" totalImagesPullingTime="3.154796048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:26.411395817 +0000 UTC m=+251.373392824" watchObservedRunningTime="2026-07-29 01:13:26.413413843 +0000 UTC m=+251.375410853"
Jul 29 01:13:26.426157 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.426099    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft" podStartSLOduration=1.106713776 podStartE2EDuration="4.426080031s" totalImagesPullingTime="3.319366255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:26.425447918 +0000 UTC m=+251.387444925" watchObservedRunningTime="2026-07-29 01:13:26.426080031 +0000 UTC m=+251.388077038"
Jul 29 01:13:26.450023 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:26.449936    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-j6h2q" podStartSLOduration=1.154191767 podStartE2EDuration="4.449912495s" totalImagesPullingTime="3.295720728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:26.448867892 +0000 UTC m=+251.410864900" watchObservedRunningTime="2026-07-29 01:13:26.449912495 +0000 UTC m=+251.411909504"
Jul 29 01:13:27.195710 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.195666    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d5t74"]
Jul 29 01:13:27.199391 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.199360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.201775 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.201753    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:13:27.202232 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.202215    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:13:27.202567 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.202551    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbnhx\""
Jul 29 01:13:27.211534 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.211511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d5t74"]
Jul 29 01:13:27.330944 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.330901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-data-volume\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.331109 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.330959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-crio-socket\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.331109 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.331021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.331276 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.331134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2458\" (UniqueName: \"kubernetes.io/projected/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-api-access-v2458\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.331276 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.331226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.405289 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.405259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/0.log"
Jul 29 01:13:27.405731 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.405300    2563 generic.go:356] "Generic (PLEG): container finished" podID="dea64566-9623-486c-9232-8237e03de953" containerID="1f151d8102f6c062fd1721582e70e39d133ab3fd8e95cba8443145cd82f1f6f3" exitCode=255
Jul 29 01:13:27.405731 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.405381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" event={"ID":"dea64566-9623-486c-9232-8237e03de953","Type":"ContainerDied","Data":"1f151d8102f6c062fd1721582e70e39d133ab3fd8e95cba8443145cd82f1f6f3"}
Jul 29 01:13:27.405731 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.405610    2563 scope.go:117] "RemoveContainer" containerID="1f151d8102f6c062fd1721582e70e39d133ab3fd8e95cba8443145cd82f1f6f3"
Jul 29 01:13:27.432351 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-data-volume\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-crio-socket\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:13:27.432520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2458\" (UniqueName: \"kubernetes.io/projected/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-api-access-v2458\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432663 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-crio-socket\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432663 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.432546    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.432663 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.432573    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:13:27.432663 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432663 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.432637    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.932618105 +0000 UTC m=+252.894615127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.432663 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.432643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-data-volume\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.432852 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.432708    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.432852 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.432714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs podName:4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce nodeName:}" failed. No retries permitted until 2026-07-29 01:15:29.43267677 +0000 UTC m=+374.394673770 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs") pod "network-metrics-daemon-z4z76" (UID: "4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce") : secret "metrics-daemon-secret" not found
Jul 29 01:13:27.432852 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.432751    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.932730953 +0000 UTC m=+252.894727941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.440076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.440048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2458\" (UniqueName: \"kubernetes.io/projected/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-api-access-v2458\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.561233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.561205    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"]
Jul 29 01:13:27.564215 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.564179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"
Jul 29 01:13:27.566434 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.566412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 01:13:27.566508 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.566413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jrrwv\""
Jul 29 01:13:27.566508 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.566412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:27.572979 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.572955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"]
Jul 29 01:13:27.635208 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.635156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clq5k\" (UniqueName: \"kubernetes.io/projected/a4259daa-3aa0-430b-bc3e-b5e9aacab2ed-kube-api-access-clq5k\") pod \"migrator-6865c9967-xtgz2\" (UID: \"a4259daa-3aa0-430b-bc3e-b5e9aacab2ed\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"
Jul 29 01:13:27.736297 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.736206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clq5k\" (UniqueName: \"kubernetes.io/projected/a4259daa-3aa0-430b-bc3e-b5e9aacab2ed-kube-api-access-clq5k\") pod \"migrator-6865c9967-xtgz2\" (UID: \"a4259daa-3aa0-430b-bc3e-b5e9aacab2ed\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"
Jul 29 01:13:27.744168 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.744139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clq5k\" (UniqueName: \"kubernetes.io/projected/a4259daa-3aa0-430b-bc3e-b5e9aacab2ed-kube-api-access-clq5k\") pod \"migrator-6865c9967-xtgz2\" (UID: \"a4259daa-3aa0-430b-bc3e-b5e9aacab2ed\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"
Jul 29 01:13:27.905610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.905567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"
Jul 29 01:13:27.937886 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.937854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.938040 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:27.937954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:27.938040 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.937978    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.938112 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.938048    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:28.938029433 +0000 UTC m=+253.900026418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.938112 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.938079    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.938247 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:27.938134    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:28.938119516 +0000 UTC m=+253.900116510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.029953 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.029930    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2"]
Jul 29 01:13:28.410686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.410658    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:13:28.411081 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.411034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/0.log"
Jul 29 01:13:28.411081 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.411066    2563 generic.go:356] "Generic (PLEG): container finished" podID="dea64566-9623-486c-9232-8237e03de953" containerID="243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3" exitCode=255
Jul 29 01:13:28.411170 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.411135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" event={"ID":"dea64566-9623-486c-9232-8237e03de953","Type":"ContainerDied","Data":"243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3"}
Jul 29 01:13:28.411254 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.411238    2563 scope.go:117] "RemoveContainer" containerID="1f151d8102f6c062fd1721582e70e39d133ab3fd8e95cba8443145cd82f1f6f3"
Jul 29 01:13:28.411519 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.411487    2563 scope.go:117] "RemoveContainer" containerID="243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3"
Jul 29 01:13:28.411689 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:28.411671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-j4vgn_openshift-console-operator(dea64566-9623-486c-9232-8237e03de953)\"" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" podUID="dea64566-9623-486c-9232-8237e03de953"
Jul 29 01:13:28.412548 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.412357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2" event={"ID":"a4259daa-3aa0-430b-bc3e-b5e9aacab2ed","Type":"ContainerStarted","Data":"a3fb3c8d88d26d729a840305f8fb03bfd3c82e623fdd0c279b424573e4376ac6"}
Jul 29 01:13:28.418533 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.418510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hbwbp"]
Jul 29 01:13:28.427296 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.427280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.431730 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.431710    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 01:13:28.431815 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.431728    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dpshh\""
Jul 29 01:13:28.432174 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.432155    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 01:13:28.432369 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.432350    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 01:13:28.432467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.432401    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 01:13:28.433679 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.433661    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hbwbp"]
Jul 29 01:13:28.543202 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.543148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgxcn\" (UniqueName: \"kubernetes.io/projected/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-kube-api-access-fgxcn\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.543383 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.543300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-signing-key\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.543441 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.543399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-signing-cabundle\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.644813 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.644762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgxcn\" (UniqueName: \"kubernetes.io/projected/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-kube-api-access-fgxcn\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.644993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.644854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-signing-key\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.644993 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.644927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-signing-cabundle\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.645675 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.645644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-signing-cabundle\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.647377 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.647350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-signing-key\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.652996 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.652971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgxcn\" (UniqueName: \"kubernetes.io/projected/e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7-kube-api-access-fgxcn\") pod \"service-ca-658d7b7c78-hbwbp\" (UID: \"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7\") " pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.736691 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.736598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp"
Jul 29 01:13:28.873538 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.873410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hbwbp"]
Jul 29 01:13:28.948135 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.948089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:28.948321 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.948203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:28.948321 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:28.948268    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:28.948448 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:28.948345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.948325161 +0000 UTC m=+255.910322170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:28.948448 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:28.948270    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.948448 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:28.948429    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.94841063 +0000 UTC m=+255.910407615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.997711 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:28.997632    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4hggq_72029676-fdd6-4746-93ef-51b93cdea875/dns-node-resolver/0.log"
Jul 29 01:13:29.055976 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:29.055934    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2be8c3a_cbdb_4fcd_afad_9a6e998ef0f7.slice/crio-e86ab57669de6056c6502a5998f44c11b03009d79c41e6be85e2d7594e385355 WatchSource:0}: Error finding container e86ab57669de6056c6502a5998f44c11b03009d79c41e6be85e2d7594e385355: Status 404 returned error can't find the container with id e86ab57669de6056c6502a5998f44c11b03009d79c41e6be85e2d7594e385355
Jul 29 01:13:29.417303 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.417277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:13:29.417708 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.417667    2563 scope.go:117] "RemoveContainer" containerID="243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3"
Jul 29 01:13:29.417857 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:29.417833    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-j4vgn_openshift-console-operator(dea64566-9623-486c-9232-8237e03de953)\"" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" podUID="dea64566-9623-486c-9232-8237e03de953"
Jul 29 01:13:29.419083 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.419052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2" event={"ID":"a4259daa-3aa0-430b-bc3e-b5e9aacab2ed","Type":"ContainerStarted","Data":"ad0f4b325f11ac68130bd078b4c27e3a309abef94a7b6125db272d47e0ef9ed2"}
Jul 29 01:13:29.419216 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.419098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2" event={"ID":"a4259daa-3aa0-430b-bc3e-b5e9aacab2ed","Type":"ContainerStarted","Data":"ce496062aa787d1977bcd12d36f74ff6733cf69cc2d54deec112218bc0951ddd"}
Jul 29 01:13:29.420150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.420130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp" event={"ID":"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7","Type":"ContainerStarted","Data":"e86ab57669de6056c6502a5998f44c11b03009d79c41e6be85e2d7594e385355"}
Jul 29 01:13:29.455564 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.455515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtgz2" podStartSLOduration=1.390650185 podStartE2EDuration="2.45550139s" totalImagesPullingTime="1.064851205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:29.454918276 +0000 UTC m=+254.416915283" watchObservedRunningTime="2026-07-29 01:13:29.45550139 +0000 UTC m=+254.417498396"
Jul 29 01:13:29.995816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:29.995783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5jxs_4ce56aef-1689-4ec9-b2bd-687357a6a87a/node-ca/0.log"
Jul 29 01:13:30.362236 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:30.362140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:30.362368 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:30.362291    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 01:13:30.362368 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:30.362354    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls podName:872e64d9-f33e-4661-a71a-80c56957f536 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:38.362338276 +0000 UTC m=+263.324335262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls") pod "cluster-samples-operator-6748489656-lkncw" (UID: "872e64d9-f33e-4661-a71a-80c56957f536") : secret "samples-operator-tls" not found
Jul 29 01:13:30.968363 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:30.968323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:30.968792 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:30.968435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:30.968792 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:30.968498    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:30.968792 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:30.968559    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:30.968792 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:30.968585    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:34.968562891 +0000 UTC m=+259.930559880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:30.968792 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:30.968609    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:34.96859655 +0000 UTC m=+259.930593536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:30.997394 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:30.997366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tlrfb_8962e9cc-2da2-494b-b328-f64b0fb90b81/serve-healthcheck-canary/0.log"
Jul 29 01:13:31.428275 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:31.428240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp" event={"ID":"e2be8c3a-cbdb-4fcd-afad-9a6e998ef0f7","Type":"ContainerStarted","Data":"01b5a3edb61d390058ccd5151b57f71fbc8eac882e7076240072a3c16f6804e9"}
Jul 29 01:13:31.448665 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:31.448606    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-hbwbp" podStartSLOduration=1.6296124239999998 podStartE2EDuration="3.448586714s" totalImagesPullingTime="1.81897429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:31.447147891 +0000 UTC m=+256.409144898" watchObservedRunningTime="2026-07-29 01:13:31.448586714 +0000 UTC m=+256.410583720"
Jul 29 01:13:32.974994 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:32.974952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:32.976090 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:32.976068    2563 scope.go:117] "RemoveContainer" containerID="243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3"
Jul 29 01:13:32.976325 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:32.976291    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-j4vgn_openshift-console-operator(dea64566-9623-486c-9232-8237e03de953)\"" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" podUID="dea64566-9623-486c-9232-8237e03de953"
Jul 29 01:13:35.009634 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:35.009587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:35.010034 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:35.009732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:35.010034 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:35.009737    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:35.010034 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:35.009815    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.009794318 +0000 UTC m=+267.971791303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:35.010034 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:35.009841    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:35.010034 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:35.009891    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm podName:6d490e5b-ff8a-4e88-bf0f-a2a037388bab nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.009877812 +0000 UTC m=+267.971874797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5t74" (UID: "6d490e5b-ff8a-4e88-bf0f-a2a037388bab") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:36.397530 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:36.397483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:36.398012 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:36.397991    2563 scope.go:117] "RemoveContainer" containerID="243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3"
Jul 29 01:13:36.398274 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:36.398247    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-j4vgn_openshift-console-operator(dea64566-9623-486c-9232-8237e03de953)\"" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" podUID="dea64566-9623-486c-9232-8237e03de953"
Jul 29 01:13:38.440249 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:38.440112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:38.442675 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:38.442643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/872e64d9-f33e-4661-a71a-80c56957f536-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lkncw\" (UID: \"872e64d9-f33e-4661-a71a-80c56957f536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:38.560725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:38.560679    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"
Jul 29 01:13:38.693501 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:38.693409    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw"]
Jul 29 01:13:39.456480 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:39.456444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw" event={"ID":"872e64d9-f33e-4661-a71a-80c56957f536","Type":"ContainerStarted","Data":"61ee29d381e7955efac3357cab8b07598d9343ccde192571b117c52530142c43"}
Jul 29 01:13:40.461288 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:40.461214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw" event={"ID":"872e64d9-f33e-4661-a71a-80c56957f536","Type":"ContainerStarted","Data":"9531c1e065f019a6cd310fa16efb5384f80e5ea201a9a4d8e23145ff01fdde86"}
Jul 29 01:13:40.461288 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:40.461266    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw" event={"ID":"872e64d9-f33e-4661-a71a-80c56957f536","Type":"ContainerStarted","Data":"2239ea07afc5f1aee246c245b397fc1bbf36b8a1bcfdcf94bf61549cb005d320"}
Jul 29 01:13:40.477935 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:40.477885    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lkncw" podStartSLOduration=17.014570855 podStartE2EDuration="18.477867436s" totalImagesPullingTime="1.463296581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:40.476813393 +0000 UTC m=+265.438810402" watchObservedRunningTime="2026-07-29 01:13:40.477867436 +0000 UTC m=+265.439864442"
Jul 29 01:13:43.081129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.081092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:43.081526 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.081148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:43.081800 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.081768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:43.083533 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.083511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d490e5b-ff8a-4e88-bf0f-a2a037388bab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5t74\" (UID: \"6d490e5b-ff8a-4e88-bf0f-a2a037388bab\") " pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:43.110659 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.110638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d5t74"
Jul 29 01:13:43.236760 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.236724    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d5t74"]
Jul 29 01:13:43.240745 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:43.240709    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d490e5b_ff8a_4e88_bf0f_a2a037388bab.slice/crio-18aaddec1cfdc433a3744e02545469a56c45f139b2c2d01387521e9194fa4257 WatchSource:0}: Error finding container 18aaddec1cfdc433a3744e02545469a56c45f139b2c2d01387521e9194fa4257: Status 404 returned error can't find the container with id 18aaddec1cfdc433a3744e02545469a56c45f139b2c2d01387521e9194fa4257
Jul 29 01:13:43.471959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:43.471918    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5t74" event={"ID":"6d490e5b-ff8a-4e88-bf0f-a2a037388bab","Type":"ContainerStarted","Data":"18aaddec1cfdc433a3744e02545469a56c45f139b2c2d01387521e9194fa4257"}
Jul 29 01:13:48.490839 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:48.490806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5t74" event={"ID":"6d490e5b-ff8a-4e88-bf0f-a2a037388bab","Type":"ContainerStarted","Data":"dd18a52195a0e36ceef244d10b8c7330a28188c6fb508e48d15409345a5f098a"}
Jul 29 01:13:48.539530 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:48.539502    2563 scope.go:117] "RemoveContainer" containerID="243ab57dba9b07714813d230e05ddeba128deb5c4f5a772f31d919b0dbc7ffc3"
Jul 29 01:13:49.497284 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:49.497252    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:13:49.497818 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:49.497347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn" event={"ID":"dea64566-9623-486c-9232-8237e03de953","Type":"ContainerStarted","Data":"13d2cb114395ad2b13846e5a286db5ca747afa9a90595eede9e04f965bf5c911"}
Jul 29 01:13:49.497818 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:49.497640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:49.973087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:49.973053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-j4vgn"
Jul 29 01:13:52.342365 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.342330    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-zgmsj"]
Jul 29 01:13:52.347753 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.347726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:13:52.350436 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.350288    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 01:13:52.350436 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.350406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 01:13:52.351079 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.350446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bfwng\""
Jul 29 01:13:52.362379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.362347    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-zgmsj"]
Jul 29 01:13:52.367376 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.367301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c84g\" (UniqueName: \"kubernetes.io/projected/10e34f2e-caf3-4fb9-b78e-70c977aa4193-kube-api-access-7c84g\") pod \"downloads-7c97dc4555-zgmsj\" (UID: \"10e34f2e-caf3-4fb9-b78e-70c977aa4193\") " pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:13:52.468516 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.468478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c84g\" (UniqueName: \"kubernetes.io/projected/10e34f2e-caf3-4fb9-b78e-70c977aa4193-kube-api-access-7c84g\") pod \"downloads-7c97dc4555-zgmsj\" (UID: \"10e34f2e-caf3-4fb9-b78e-70c977aa4193\") " pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:13:52.479849 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.479818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c84g\" (UniqueName: \"kubernetes.io/projected/10e34f2e-caf3-4fb9-b78e-70c977aa4193-kube-api-access-7c84g\") pod \"downloads-7c97dc4555-zgmsj\" (UID: \"10e34f2e-caf3-4fb9-b78e-70c977aa4193\") " pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:13:52.515069 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.515025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5t74" event={"ID":"6d490e5b-ff8a-4e88-bf0f-a2a037388bab","Type":"ContainerStarted","Data":"1efaf07c1ab1f4273b0d45810219177fd2015d7f034fd81773f22a73746d0d7d"}
Jul 29 01:13:52.660264 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.660215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:13:52.812542 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:52.812419    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-zgmsj"]
Jul 29 01:13:52.814902 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:13:52.814863    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e34f2e_caf3_4fb9_b78e_70c977aa4193.slice/crio-f7cd3e3e284d0976e6e5cd29ee9763949bb2fd4716a1803443d1facc3af690d1 WatchSource:0}: Error finding container f7cd3e3e284d0976e6e5cd29ee9763949bb2fd4716a1803443d1facc3af690d1: Status 404 returned error can't find the container with id f7cd3e3e284d0976e6e5cd29ee9763949bb2fd4716a1803443d1facc3af690d1
Jul 29 01:13:53.521821 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:53.521766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-zgmsj" event={"ID":"10e34f2e-caf3-4fb9-b78e-70c977aa4193","Type":"ContainerStarted","Data":"f7cd3e3e284d0976e6e5cd29ee9763949bb2fd4716a1803443d1facc3af690d1"}
Jul 29 01:13:56.536038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:56.535997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5t74" event={"ID":"6d490e5b-ff8a-4e88-bf0f-a2a037388bab","Type":"ContainerStarted","Data":"09b9155e2106e03b950b11c326598bf10874e4a9f426e29c6cf7ab29d3c7c079"}
Jul 29 01:13:56.556329 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:56.556272    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d5t74" podStartSLOduration=17.318486663 podStartE2EDuration="29.55625532s" totalImagesPullingTime="12.237768657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:56.555019682 +0000 UTC m=+281.517016690" watchObservedRunningTime="2026-07-29 01:13:56.55625532 +0000 UTC m=+281.518252326"
Jul 29 01:13:57.167164 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:57.167115    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6" podUID="6a7ffbea-57e3-49a4-8c7c-686251a9111e"
Jul 29 01:13:57.167164 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:57.167144    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75"
Jul 29 01:13:57.167412 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:13:57.167115    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z64kk" podUID="dac8e08e-8f19-430f-b101-a08c3259fc5a"
Jul 29 01:13:57.540071 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:57.539963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:13:57.540071 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:57.539963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:13:57.540614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:13:57.540174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z64kk"
Jul 29 01:14:00.444615 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.444577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:14:00.445124 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.444633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:00.445124 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.444668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:14:00.447719 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.447662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"image-registry-5bcb5c66fc-8fz2f\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") " pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:00.447719 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.447676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dac8e08e-8f19-430f-b101-a08c3259fc5a-metrics-tls\") pod \"dns-default-z64kk\" (UID: \"dac8e08e-8f19-430f-b101-a08c3259fc5a\") " pod="openshift-dns/dns-default-z64kk"
Jul 29 01:14:00.447719 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.447689    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a7ffbea-57e3-49a4-8c7c-686251a9111e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-597h6\" (UID: \"6a7ffbea-57e3-49a4-8c7c-686251a9111e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:14:00.543860 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.543825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zd58l\""
Jul 29 01:14:00.543860 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.543825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ch94d\""
Jul 29 01:14:00.544062 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.543825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lfkw5\""
Jul 29 01:14:00.550883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.550851    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z64kk"
Jul 29 01:14:00.551064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.550945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:00.551064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.550963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6"
Jul 29 01:14:00.830664 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.830608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z64kk"]
Jul 29 01:14:00.834961 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:00.834922    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac8e08e_8f19_430f_b101_a08c3259fc5a.slice/crio-77bbd8a82c0c44905472dba1e6e79bda69d2eb212b90e71bd079ca6251cae420 WatchSource:0}: Error finding container 77bbd8a82c0c44905472dba1e6e79bda69d2eb212b90e71bd079ca6251cae420: Status 404 returned error can't find the container with id 77bbd8a82c0c44905472dba1e6e79bda69d2eb212b90e71bd079ca6251cae420
Jul 29 01:14:00.870163 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.870129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"]
Jul 29 01:14:00.875617 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:00.875582    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7a5ab5_7b89_4a33_8191_6054ffb58d75.slice/crio-88f7fccbfd4d866c4fd7fb188083be36ce4e05d7b2619a54998d9544430d9436 WatchSource:0}: Error finding container 88f7fccbfd4d866c4fd7fb188083be36ce4e05d7b2619a54998d9544430d9436: Status 404 returned error can't find the container with id 88f7fccbfd4d866c4fd7fb188083be36ce4e05d7b2619a54998d9544430d9436
Jul 29 01:14:00.893997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:00.893956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-597h6"]
Jul 29 01:14:00.897461 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:00.897426    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7ffbea_57e3_49a4_8c7c_686251a9111e.slice/crio-c97d3b283c455f95141577f3c8c1c053667ff305b03ffa8161170919ab8ab132 WatchSource:0}: Error finding container c97d3b283c455f95141577f3c8c1c053667ff305b03ffa8161170919ab8ab132: Status 404 returned error can't find the container with id c97d3b283c455f95141577f3c8c1c053667ff305b03ffa8161170919ab8ab132
Jul 29 01:14:01.558078 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:01.557969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6" event={"ID":"6a7ffbea-57e3-49a4-8c7c-686251a9111e","Type":"ContainerStarted","Data":"c97d3b283c455f95141577f3c8c1c053667ff305b03ffa8161170919ab8ab132"}
Jul 29 01:14:01.559962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:01.559849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z64kk" event={"ID":"dac8e08e-8f19-430f-b101-a08c3259fc5a","Type":"ContainerStarted","Data":"77bbd8a82c0c44905472dba1e6e79bda69d2eb212b90e71bd079ca6251cae420"}
Jul 29 01:14:01.562801 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:01.561970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" event={"ID":"4c7a5ab5-7b89-4a33-8191-6054ffb58d75","Type":"ContainerStarted","Data":"c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644"}
Jul 29 01:14:01.562801 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:01.562020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" event={"ID":"4c7a5ab5-7b89-4a33-8191-6054ffb58d75","Type":"ContainerStarted","Data":"88f7fccbfd4d866c4fd7fb188083be36ce4e05d7b2619a54998d9544430d9436"}
Jul 29 01:14:01.562801 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:01.562772    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:01.582706 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:01.582641    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podStartSLOduration=285.582617172 podStartE2EDuration="4m45.582617172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:01.581756272 +0000 UTC m=+286.543753278" watchObservedRunningTime="2026-07-29 01:14:01.582617172 +0000 UTC m=+286.544614159"
Jul 29 01:14:02.611225 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.611151    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8slr8"]
Jul 29 01:14:02.676126 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.676085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8slr8"]
Jul 29 01:14:02.676347 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.676105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.679532 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.679500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 01:14:02.679691 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.679542    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:14:02.679691 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.679507    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:14:02.680075 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.680056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:14:02.680178 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.680092    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 01:14:02.680178 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.680062    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qrdc6\""
Jul 29 01:14:02.770550 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.770484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkcg\" (UniqueName: \"kubernetes.io/projected/f39816d9-cf76-4519-a696-4146edf0aea7-kube-api-access-wdkcg\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.770550 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.770541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f39816d9-cf76-4519-a696-4146edf0aea7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.770807 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.770578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f39816d9-cf76-4519-a696-4146edf0aea7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.770807 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.770617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39816d9-cf76-4519-a696-4146edf0aea7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.871245 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.871215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkcg\" (UniqueName: \"kubernetes.io/projected/f39816d9-cf76-4519-a696-4146edf0aea7-kube-api-access-wdkcg\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.871437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.871256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f39816d9-cf76-4519-a696-4146edf0aea7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.871501 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.871456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f39816d9-cf76-4519-a696-4146edf0aea7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.871567 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.871524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39816d9-cf76-4519-a696-4146edf0aea7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.872045 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.872019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f39816d9-cf76-4519-a696-4146edf0aea7-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.874455 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.874428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f39816d9-cf76-4519-a696-4146edf0aea7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.874582 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.874572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f39816d9-cf76-4519-a696-4146edf0aea7-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.880198 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.880153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkcg\" (UniqueName: \"kubernetes.io/projected/f39816d9-cf76-4519-a696-4146edf0aea7-kube-api-access-wdkcg\") pod \"prometheus-operator-84d69f794d-8slr8\" (UID: \"f39816d9-cf76-4519-a696-4146edf0aea7\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:02.989864 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:02.989828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8"
Jul 29 01:14:10.443258 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:10.443219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8slr8"]
Jul 29 01:14:10.446363 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:10.446318    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39816d9_cf76_4519_a696_4146edf0aea7.slice/crio-cbefa675373170d1307b28cb38bb6ec43bde83ae1e0e2dd1c4ac5cb916dc269f WatchSource:0}: Error finding container cbefa675373170d1307b28cb38bb6ec43bde83ae1e0e2dd1c4ac5cb916dc269f: Status 404 returned error can't find the container with id cbefa675373170d1307b28cb38bb6ec43bde83ae1e0e2dd1c4ac5cb916dc269f
Jul 29 01:14:10.597692 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:10.597595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6" event={"ID":"6a7ffbea-57e3-49a4-8c7c-686251a9111e","Type":"ContainerStarted","Data":"598d1b6131ecf55cf72d5e8f34bcd252f798ae63f999fce7c0ba5c8f3b148688"}
Jul 29 01:14:10.599244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:10.599217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z64kk" event={"ID":"dac8e08e-8f19-430f-b101-a08c3259fc5a","Type":"ContainerStarted","Data":"cd94ee6a24056bdf8d26f3ad29a2a74dd08889eec890a6268576907b8ce84ed6"}
Jul 29 01:14:10.600439 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:10.600416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8" event={"ID":"f39816d9-cf76-4519-a696-4146edf0aea7","Type":"ContainerStarted","Data":"cbefa675373170d1307b28cb38bb6ec43bde83ae1e0e2dd1c4ac5cb916dc269f"}
Jul 29 01:14:10.612582 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:10.612528    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-597h6" podStartSLOduration=284.214391159 podStartE2EDuration="4m53.612511431s" totalImagesPullingTime="9.398120272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:10.611808486 +0000 UTC m=+295.573805493" watchObservedRunningTime="2026-07-29 01:14:10.612511431 +0000 UTC m=+295.574508437"
Jul 29 01:14:11.539108 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:14:11.539051    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z4z76" podUID="4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce"
Jul 29 01:14:11.609218 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:11.608840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-zgmsj" event={"ID":"10e34f2e-caf3-4fb9-b78e-70c977aa4193","Type":"ContainerStarted","Data":"150db9192c3f51e20f44b7d8cbbf0b0617be14eb2f3429996994a00e65289f95"}
Jul 29 01:14:11.609218 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:11.609111    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:14:11.612974 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:11.612898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z64kk" event={"ID":"dac8e08e-8f19-430f-b101-a08c3259fc5a","Type":"ContainerStarted","Data":"cc4d668e4bd014c0561580768fe55752a2d8b49834cdb279b95422fe31ec8d5b"}
Jul 29 01:14:11.623180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:11.623145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-zgmsj"
Jul 29 01:14:11.627853 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:11.627723    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-zgmsj" podStartSLOduration=1.652054742 podStartE2EDuration="19.627699184s" totalImagesPullingTime="17.975644442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:11.62702894 +0000 UTC m=+296.589025984" watchObservedRunningTime="2026-07-29 01:14:11.627699184 +0000 UTC m=+296.589696193"
Jul 29 01:14:11.668298 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:11.666963    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z64kk" podStartSLOduration=252.207603657 podStartE2EDuration="4m21.666937325s" totalImagesPullingTime="9.459333668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:11.665707584 +0000 UTC m=+296.627704592" watchObservedRunningTime="2026-07-29 01:14:11.666937325 +0000 UTC m=+296.628934333"
Jul 29 01:14:12.619694 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:12.619652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8" event={"ID":"f39816d9-cf76-4519-a696-4146edf0aea7","Type":"ContainerStarted","Data":"3af4a1d077b01795460ad477d56a42fde9aea8b508088ec5f1d8ea59bfcddd8a"}
Jul 29 01:14:12.620180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:12.619721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8" event={"ID":"f39816d9-cf76-4519-a696-4146edf0aea7","Type":"ContainerStarted","Data":"726097f7771b2e2a93261dbf960c564ebbec73c9c97b62372cdca629e75388f2"}
Jul 29 01:14:12.620292 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:12.620229    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z64kk"
Jul 29 01:14:12.640139 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:12.640074    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-8slr8" podStartSLOduration=9.252999369 podStartE2EDuration="10.640052085s" totalImagesPullingTime="1.387052716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:12.638571457 +0000 UTC m=+297.600568486" watchObservedRunningTime="2026-07-29 01:14:12.640052085 +0000 UTC m=+297.602049090"
Jul 29 01:14:14.990334 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:14.990287    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"]
Jul 29 01:14:15.011467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.011424    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4vfc2"]
Jul 29 01:14:15.012076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.012050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.019490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.018052    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 01:14:15.019677 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.019649    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 01:14:15.020698 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.020677    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 01:14:15.029028 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.027530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"]
Jul 29 01:14:15.029028 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.027582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.029028 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.027790    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-59g2b\""
Jul 29 01:14:15.031038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.030053    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:14:15.031038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.030433    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:14:15.031038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.030676    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:14:15.031038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.030985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56rrk\""
Jul 29 01:14:15.186487 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67m28\" (UniqueName: \"kubernetes.io/projected/c081c6a0-a010-41e4-888b-ce445d719c27-kube-api-access-67m28\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.186685 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-textfile\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.186685 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.186685 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-sys\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.186685 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c081c6a0-a010-41e4-888b-ce445d719c27-metrics-client-ca\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.186923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd0ca93d-e812-4100-9864-49ff1dcc0dff-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.186923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.186923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-tls\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.186923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms6rv\" (UniqueName: \"kubernetes.io/projected/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-api-access-ms6rv\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.186923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.186923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.187266 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-root\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.187266 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-wtmp\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.187266 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.186991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.187266 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.187032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0ca93d-e812-4100-9864-49ff1dcc0dff-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.288656 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.288562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0ca93d-e812-4100-9864-49ff1dcc0dff-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.289585 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67m28\" (UniqueName: \"kubernetes.io/projected/c081c6a0-a010-41e4-888b-ce445d719c27-kube-api-access-67m28\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.289713 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-textfile\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.289713 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.289713 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-sys\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.289713 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c081c6a0-a010-41e4-888b-ce445d719c27-metrics-client-ca\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.289915 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd0ca93d-e812-4100-9864-49ff1dcc0dff-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.289915 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.289915 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-tls\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.289915 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms6rv\" (UniqueName: \"kubernetes.io/projected/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-api-access-ms6rv\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.290104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.290104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.290104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-root\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.290104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.289994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-wtmp\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.290104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.290024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.290740 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.290577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd0ca93d-e812-4100-9864-49ff1dcc0dff-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.290740 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:14:15.290616    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 01:14:15.290740 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:14:15.290694    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-tls podName:c081c6a0-a010-41e4-888b-ce445d719c27 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:15.790672761 +0000 UTC m=+300.752669761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-tls") pod "node-exporter-4vfc2" (UID: "c081c6a0-a010-41e4-888b-ce445d719c27") : secret "node-exporter-tls" not found
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.291544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.291634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.291683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-textfile\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.291697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-wtmp\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.291687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-root\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.291766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c081c6a0-a010-41e4-888b-ce445d719c27-sys\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.292087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.292011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd0ca93d-e812-4100-9864-49ff1dcc0dff-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.292554 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.292134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c081c6a0-a010-41e4-888b-ce445d719c27-metrics-client-ca\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.298213 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.298151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.308207 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.308159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.311780 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.311742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.312365 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.312331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms6rv\" (UniqueName: \"kubernetes.io/projected/bd0ca93d-e812-4100-9864-49ff1dcc0dff-kube-api-access-ms6rv\") pod \"kube-state-metrics-56d9f944b4-rvcmv\" (UID: \"bd0ca93d-e812-4100-9864-49ff1dcc0dff\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.313785 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.313762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67m28\" (UniqueName: \"kubernetes.io/projected/c081c6a0-a010-41e4-888b-ce445d719c27-kube-api-access-67m28\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.328773 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.328735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"
Jul 29 01:14:15.501997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.501744    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:14:15.501997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.501930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:14:15.875744 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:15.554234    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0ca93d_e812_4100_9864_49ff1dcc0dff.slice/crio-829958e20121de6d41065cb9c16bbc8bf6bd196108e89d0ac5fb32c6bc609fc1 WatchSource:0}: Error finding container 829958e20121de6d41065cb9c16bbc8bf6bd196108e89d0ac5fb32c6bc609fc1: Status 404 returned error can't find the container with id 829958e20121de6d41065cb9c16bbc8bf6bd196108e89d0ac5fb32c6bc609fc1
Jul 29 01:14:15.875744 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.555160    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv"]
Jul 29 01:14:15.875744 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.562020    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:14:15.875744 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.637942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv" event={"ID":"bd0ca93d-e812-4100-9864-49ff1dcc0dff","Type":"ContainerStarted","Data":"829958e20121de6d41065cb9c16bbc8bf6bd196108e89d0ac5fb32c6bc609fc1"}
Jul 29 01:14:15.875744 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.793895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-tls\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.875744 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.796650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c081c6a0-a010-41e4-888b-ce445d719c27-node-exporter-tls\") pod \"node-exporter-4vfc2\" (UID: \"c081c6a0-a010-41e4-888b-ce445d719c27\") " pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.949976 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.949763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56rrk\""
Jul 29 01:14:15.958545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:15.958501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4vfc2"
Jul 29 01:14:15.985621 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:15.985581    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc081c6a0_a010_41e4_888b_ce445d719c27.slice/crio-f486305b7dbb9a123eb25dcf1306a073bda93020e496f4ad9d6af2a5dc4594c7 WatchSource:0}: Error finding container f486305b7dbb9a123eb25dcf1306a073bda93020e496f4ad9d6af2a5dc4594c7: Status 404 returned error can't find the container with id f486305b7dbb9a123eb25dcf1306a073bda93020e496f4ad9d6af2a5dc4594c7
Jul 29 01:14:16.012629 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.012582    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:14:16.038708 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.038671    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:14:16.038897 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.038793    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.041262    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.041575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.041769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qpbp7\""
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.041929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.042082    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.042486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 01:14:16.042737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.042704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 01:14:16.043216 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.042885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 01:14:16.043216 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.043056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 01:14:16.043322 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.043279    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 01:14:16.198160 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198160 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9gnb\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-kube-api-access-h9gnb\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-volume\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-web-config\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198463 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-out\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.198855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.198564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305652 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9gnb\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-kube-api-access-h9gnb\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.305843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-volume\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-web-config\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.305970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.306001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.306049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-out\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.306071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.306598 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.306571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.312485 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.310208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.312485 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:14:16.310735    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 29 01:14:16.312485 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:14:16.310828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls podName:24b4c6d8-2478-426a-80f8-cb08eb059b30 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:16.81080443 +0000 UTC m=+301.772801428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30") : secret "alertmanager-main-tls" not found
Jul 29 01:14:16.312485 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.312089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.318225 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.316550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.318225 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.317835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.321458 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.321430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.321643 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.321615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-volume\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.322682 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.322629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.322882 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.322861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-web-config\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.323090 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.323071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-out\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.324227 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.324156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9gnb\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-kube-api-access-h9gnb\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.324378 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.324350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.647129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.647043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vfc2" event={"ID":"c081c6a0-a010-41e4-888b-ce445d719c27","Type":"ContainerStarted","Data":"f486305b7dbb9a123eb25dcf1306a073bda93020e496f4ad9d6af2a5dc4594c7"}
Jul 29 01:14:16.812430 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.811596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.821704 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.821669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:16.953401 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:16.953299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:14:18.235915 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.235811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:14:18.246720 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.246694    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:14:18.661705 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.660943    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv" event={"ID":"bd0ca93d-e812-4100-9864-49ff1dcc0dff","Type":"ContainerStarted","Data":"5edcf9cc181238acd9f0a090a780b95f99c72cd6401ff63483df658297e3f631"}
Jul 29 01:14:18.661705 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.661058    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv" event={"ID":"bd0ca93d-e812-4100-9864-49ff1dcc0dff","Type":"ContainerStarted","Data":"0649f3cb7845a2dd9754595243496d5cd9a931c16e1af9f364d90fbe4a97336f"}
Jul 29 01:14:18.661705 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.661089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv" event={"ID":"bd0ca93d-e812-4100-9864-49ff1dcc0dff","Type":"ContainerStarted","Data":"c9aa8833f81e916794b8b1dee44f65c8217e8c1a69964baee1656364e3c78700"}
Jul 29 01:14:18.665211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.665087    2563 generic.go:356] "Generic (PLEG): container finished" podID="c081c6a0-a010-41e4-888b-ce445d719c27" containerID="7334a30df3b0a627b47f71f9da7aea6b22dc02f5dc706e224a2dd4e9cd01cfdb" exitCode=0
Jul 29 01:14:18.665211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.665126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vfc2" event={"ID":"c081c6a0-a010-41e4-888b-ce445d719c27","Type":"ContainerDied","Data":"7334a30df3b0a627b47f71f9da7aea6b22dc02f5dc706e224a2dd4e9cd01cfdb"}
Jul 29 01:14:18.667210 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.667118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"d9228b375ad0e194f110c12dbf60c0ecb39a549f0012fd9ad809efcdbad0e19e"}
Jul 29 01:14:18.678117 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:18.678046    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rvcmv" podStartSLOduration=2.209134085 podStartE2EDuration="4.678024618s" totalImagesPullingTime="2.468890533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:18.677078447 +0000 UTC m=+303.639075456" watchObservedRunningTime="2026-07-29 01:14:18.678024618 +0000 UTC m=+303.640021625"
Jul 29 01:14:19.676665 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:19.676621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vfc2" event={"ID":"c081c6a0-a010-41e4-888b-ce445d719c27","Type":"ContainerStarted","Data":"8c6697bf6d80b778f16ace8d1e94c6bf51f31578bf733309133010a3c8eb13a6"}
Jul 29 01:14:19.677313 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:19.676694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vfc2" event={"ID":"c081c6a0-a010-41e4-888b-ce445d719c27","Type":"ContainerStarted","Data":"307c61f9e4186c657d0622ed27fd3d2335d9c6949d1f2353aa8fdcce60dcae8d"}
Jul 29 01:14:20.555777 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:20.555743    2563 patch_prober.go:28] interesting pod/image-registry-5bcb5c66fc-8fz2f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:20.555951 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:20.555794    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:20.682840 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:20.682800    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4" exitCode=0
Jul 29 01:14:20.683235 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:20.682886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4"}
Jul 29 01:14:20.709927 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:20.709864    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4vfc2" podStartSLOduration=4.493716171 podStartE2EDuration="6.709845762s" totalImagesPullingTime="2.042133033s" totalInitContainerRuntime="173.996558ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:19.702290769 +0000 UTC m=+304.664287801" watchObservedRunningTime="2026-07-29 01:14:20.709845762 +0000 UTC m=+305.671842769"
Jul 29 01:14:22.637366 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:22.637299    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z64kk"
Jul 29 01:14:23.576316 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.576251    2563 patch_prober.go:28] interesting pod/image-registry-5bcb5c66fc-8fz2f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:23.576611 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.576323    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:23.699663 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.699627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72"}
Jul 29 01:14:23.700106 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.699696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250"}
Jul 29 01:14:23.700106 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.699724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d"}
Jul 29 01:14:23.700106 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.699748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f"}
Jul 29 01:14:23.700106 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:23.699770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343"}
Jul 29 01:14:24.707443 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:24.707409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerStarted","Data":"b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741"}
Jul 29 01:14:24.734786 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:24.734730    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.018553524 podStartE2EDuration="9.734712578s" totalImagesPullingTime="4.694923949s" totalInitContainerRuntime="21.235105ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:24.733595624 +0000 UTC m=+309.695592644" watchObservedRunningTime="2026-07-29 01:14:24.734712578 +0000 UTC m=+309.696709584"
Jul 29 01:14:25.463641 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:25.463601    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"]
Jul 29 01:14:25.468259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:25.468227    2563 patch_prober.go:28] interesting pod/image-registry-5bcb5c66fc-8fz2f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:25.468420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:25.468283    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:25.540497 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:25.540464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:14:26.449764 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.449728    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f85dbcd7-fbkcx"]
Jul 29 01:14:26.472005 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.471973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f85dbcd7-fbkcx"]
Jul 29 01:14:26.472170 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.472077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.474934 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.474899    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 01:14:26.475107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.474990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 01:14:26.475107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.475029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9xgr5\""
Jul 29 01:14:26.475987 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.475971    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 01:14:26.476394 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.476375    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 01:14:26.477117 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.477028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 01:14:26.489591 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.489553    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 01:14:26.499420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-oauth-serving-cert\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.499620 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-oauth-config\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.499620 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-config\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.499620 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-serving-cert\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.499742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-service-ca\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.499742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-trusted-ca-bundle\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.499742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.499708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztpc4\" (UniqueName: \"kubernetes.io/projected/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-kube-api-access-ztpc4\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.601118 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.601072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-oauth-config\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.601990 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.601963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-config\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.602855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.602831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-config\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.602967 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.602922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-serving-cert\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.602967 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.602965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-service-ca\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.603085 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.602997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-trusted-ca-bundle\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.603085 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.603027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztpc4\" (UniqueName: \"kubernetes.io/projected/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-kube-api-access-ztpc4\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.603085 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.603056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-oauth-serving-cert\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.603808 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.603783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-oauth-serving-cert\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.603922 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.603898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-trusted-ca-bundle\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.604496 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.604470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-service-ca\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.605220 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.605160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-oauth-config\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.605504 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.605484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-serving-cert\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.614006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.613981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztpc4\" (UniqueName: \"kubernetes.io/projected/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-kube-api-access-ztpc4\") pod \"console-67f85dbcd7-fbkcx\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") " pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.784969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.784866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:26.951849 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:26.951812    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f85dbcd7-fbkcx"]
Jul 29 01:14:26.954074 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:14:26.954045    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3744bb5b_cb7a_4682_9e44_2ad31f081ad1.slice/crio-4265f01e971da42c49f968fb02c4f4237a61fae8b2cd1b1bc9c71552095ed251 WatchSource:0}: Error finding container 4265f01e971da42c49f968fb02c4f4237a61fae8b2cd1b1bc9c71552095ed251: Status 404 returned error can't find the container with id 4265f01e971da42c49f968fb02c4f4237a61fae8b2cd1b1bc9c71552095ed251
Jul 29 01:14:27.720602 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:27.720550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f85dbcd7-fbkcx" event={"ID":"3744bb5b-cb7a-4682-9e44-2ad31f081ad1","Type":"ContainerStarted","Data":"4265f01e971da42c49f968fb02c4f4237a61fae8b2cd1b1bc9c71552095ed251"}
Jul 29 01:14:30.736180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:30.736137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f85dbcd7-fbkcx" event={"ID":"3744bb5b-cb7a-4682-9e44-2ad31f081ad1","Type":"ContainerStarted","Data":"84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859"}
Jul 29 01:14:30.753205 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:30.753135    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f85dbcd7-fbkcx" podStartSLOduration=1.641638227 podStartE2EDuration="4.753117137s" totalImagesPullingTime="3.11147891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:30.752375905 +0000 UTC m=+315.714372913" watchObservedRunningTime="2026-07-29 01:14:30.753117137 +0000 UTC m=+315.715114142"
Jul 29 01:14:35.469142 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:35.469110    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:36.785754 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:36.785695    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:36.785754 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:36.785773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:36.790667 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:36.790642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:37.768664 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:37.768633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:14:47.804062 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:47.804029    2563 generic.go:356] "Generic (PLEG): container finished" podID="93314bb5-d56d-4077-bccc-e9a739d7ef10" containerID="6001f27f76fd76d7d26bcca2be70e255c9a84b0477e2c30008f1a41de6c3ce27" exitCode=0
Jul 29 01:14:47.804487 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:47.804111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft" event={"ID":"93314bb5-d56d-4077-bccc-e9a739d7ef10","Type":"ContainerDied","Data":"6001f27f76fd76d7d26bcca2be70e255c9a84b0477e2c30008f1a41de6c3ce27"}
Jul 29 01:14:47.804487 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:47.804425    2563 scope.go:117] "RemoveContainer" containerID="6001f27f76fd76d7d26bcca2be70e255c9a84b0477e2c30008f1a41de6c3ce27"
Jul 29 01:14:48.810370 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:48.810337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft" event={"ID":"93314bb5-d56d-4077-bccc-e9a739d7ef10","Type":"ContainerStarted","Data":"21dd31b6ea1527902e0a7d4108488a114b5cb5f6296cc673cdf280772239c433"}
Jul 29 01:14:50.485299 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.485245    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry" containerID="cri-o://c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644" gracePeriod=30
Jul 29 01:14:50.773242 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.773180    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:50.821178 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.821140    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerID="c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644" exitCode=0
Jul 29 01:14:50.821429 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.821212    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"
Jul 29 01:14:50.821429 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.821230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" event={"ID":"4c7a5ab5-7b89-4a33-8191-6054ffb58d75","Type":"ContainerDied","Data":"c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644"}
Jul 29 01:14:50.821429 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.821282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bcb5c66fc-8fz2f" event={"ID":"4c7a5ab5-7b89-4a33-8191-6054ffb58d75","Type":"ContainerDied","Data":"88f7fccbfd4d866c4fd7fb188083be36ce4e05d7b2619a54998d9544430d9436"}
Jul 29 01:14:50.821429 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.821306    2563 scope.go:117] "RemoveContainer" containerID="c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644"
Jul 29 01:14:50.829988 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.829970    2563 scope.go:117] "RemoveContainer" containerID="c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644"
Jul 29 01:14:50.830340 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:14:50.830317    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644\": container with ID starting with c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644 not found: ID does not exist" containerID="c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644"
Jul 29 01:14:50.830409 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.830350    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644"} err="failed to get container status \"c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644\": rpc error: code = NotFound desc = could not find container \"c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644\": container with ID starting with c3a539d2b75db41ea84b3e9d244b9223a86caef1e037d370c3bcbe1223cbc644 not found: ID does not exist"
Jul 29 01:14:50.929664 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929627    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-image-registry-private-configuration\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929664 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-ca-trust-extracted\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929702    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-bound-sa-token\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929722    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-trusted-ca\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929747    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-installation-pull-secrets\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-certificates\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929815    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.929895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.929855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gmvj\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-kube-api-access-2gmvj\") pod \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\" (UID: \"4c7a5ab5-7b89-4a33-8191-6054ffb58d75\") "
Jul 29 01:14:50.930404 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.930363    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:50.930717 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.930671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:50.932496 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.932457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:50.932603 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.932546    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:50.932678 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.932612    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:50.932729 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.932681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:50.932765 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.932746    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-kube-api-access-2gmvj" (OuterVolumeSpecName: "kube-api-access-2gmvj") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "kube-api-access-2gmvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:50.940956 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:50.940929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4c7a5ab5-7b89-4a33-8191-6054ffb58d75" (UID: "4c7a5ab5-7b89-4a33-8191-6054ffb58d75"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030796    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-certificates\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030825    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-registry-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030837    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gmvj\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-kube-api-access-2gmvj\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030847    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-image-registry-private-configuration\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030856    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-ca-trust-extracted\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030864    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-bound-sa-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030872    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-trusted-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.030883 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.030880    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c7a5ab5-7b89-4a33-8191-6054ffb58d75-installation-pull-secrets\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.143237 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.143201    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"]
Jul 29 01:14:51.147724 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.147697    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bcb5c66fc-8fz2f"]
Jul 29 01:14:51.544710 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:51.544672    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" path="/var/lib/kubelet/pods/4c7a5ab5-7b89-4a33-8191-6054ffb58d75/volumes"
Jul 29 01:14:57.852157 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:57.852124    2563 generic.go:356] "Generic (PLEG): container finished" podID="8be3f6c9-65ba-4488-ad8f-776a8fc702c7" containerID="25446731c8cc111d1c4503a2ec17c90020038d08317288c81bfa084a47f58917" exitCode=0
Jul 29 01:14:57.852626 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:57.852213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j6h2q" event={"ID":"8be3f6c9-65ba-4488-ad8f-776a8fc702c7","Type":"ContainerDied","Data":"25446731c8cc111d1c4503a2ec17c90020038d08317288c81bfa084a47f58917"}
Jul 29 01:14:57.852626 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:57.852618    2563 scope.go:117] "RemoveContainer" containerID="25446731c8cc111d1c4503a2ec17c90020038d08317288c81bfa084a47f58917"
Jul 29 01:14:58.652800 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:58.652764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tlrfb_8962e9cc-2da2-494b-b328-f64b0fb90b81/serve-healthcheck-canary/0.log"
Jul 29 01:14:58.858789 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:14:58.858757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j6h2q" event={"ID":"8be3f6c9-65ba-4488-ad8f-776a8fc702c7","Type":"ContainerStarted","Data":"4b9e87f1a990dbbcbc5a7c0fb5086970d674c985610c3379539fb0f0efb2073a"}
Jul 29 01:15:29.445311 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:29.445269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:15:29.447788 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:29.447764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce-metrics-certs\") pod \"network-metrics-daemon-z4z76\" (UID: \"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce\") " pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:15:29.744176 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:29.744080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2784\""
Jul 29 01:15:29.752283 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:29.752253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4z76"
Jul 29 01:15:29.890602 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:29.890393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z4z76"]
Jul 29 01:15:29.893555 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:15:29.893524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d98c50a_a3c7_4b7a_ba69_d98afb2ca3ce.slice/crio-2c3a5e41e5db42b4292b94b62417024954e975894df917b8afc230b6daf8c696 WatchSource:0}: Error finding container 2c3a5e41e5db42b4292b94b62417024954e975894df917b8afc230b6daf8c696: Status 404 returned error can't find the container with id 2c3a5e41e5db42b4292b94b62417024954e975894df917b8afc230b6daf8c696
Jul 29 01:15:29.987411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:29.987371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4z76" event={"ID":"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce","Type":"ContainerStarted","Data":"2c3a5e41e5db42b4292b94b62417024954e975894df917b8afc230b6daf8c696"}
Jul 29 01:15:32.004015 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:32.003973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4z76" event={"ID":"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce","Type":"ContainerStarted","Data":"90b4bf5505519f6f5bf0ffe6a46cc842627017680f2166658f74cd7c59112c82"}
Jul 29 01:15:32.004524 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:32.004060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4z76" event={"ID":"4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce","Type":"ContainerStarted","Data":"93851c6cbe0c225d66d30e4c7d91b1651b09a5caab096a45858a2baf6f9a1e72"}
Jul 29 01:15:32.041214 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:32.041135    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z4z76" podStartSLOduration=374.977637293 podStartE2EDuration="6m16.04111904s" totalImagesPullingTime="1.063481747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:32.039839849 +0000 UTC m=+377.001836856" watchObservedRunningTime="2026-07-29 01:15:32.04111904 +0000 UTC m=+377.003116038"
Jul 29 01:15:35.329421 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329379    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:35.330031 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329696    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="alertmanager" containerID="cri-o://e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343" gracePeriod=120
Jul 29 01:15:35.330031 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329790    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="prom-label-proxy" containerID="cri-o://b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741" gracePeriod=120
Jul 29 01:15:35.330031 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329808    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-web" containerID="cri-o://d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d" gracePeriod=120
Jul 29 01:15:35.330031 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329846    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy" containerID="cri-o://60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250" gracePeriod=120
Jul 29 01:15:35.330031 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329925    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="config-reloader" containerID="cri-o://0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f" gracePeriod=120
Jul 29 01:15:35.330031 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:35.329785    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-metric" containerID="cri-o://c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72" gracePeriod=120
Jul 29 01:15:36.024136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024098    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741" exitCode=0
Jul 29 01:15:36.024136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024129    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72" exitCode=0
Jul 29 01:15:36.024136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024136    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250" exitCode=0
Jul 29 01:15:36.024136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024142    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f" exitCode=0
Jul 29 01:15:36.024136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024147    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343" exitCode=0
Jul 29 01:15:36.024465 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741"}
Jul 29 01:15:36.024465 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72"}
Jul 29 01:15:36.024465 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250"}
Jul 29 01:15:36.024465 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f"}
Jul 29 01:15:36.024465 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.024364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343"}
Jul 29 01:15:36.584562 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.584533    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:36.706456 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-trusted-ca-bundle\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706456 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-out\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706456 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706456 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-main-db\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706473    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-tls-assets\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-volume\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-web\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706559    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9gnb\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-kube-api-access-h9gnb\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706594    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-metrics-client-ca\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706662    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-cluster-tls-config\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.706779 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-web-config\") pod \"24b4c6d8-2478-426a-80f8-cb08eb059b30\" (UID: \"24b4c6d8-2478-426a-80f8-cb08eb059b30\") "
Jul 29 01:15:36.707295 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:36.707295 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.706923    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:36.707295 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.707220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:36.707874 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.707771    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-metrics-client-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.707874 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.707801    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.707874 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.707820    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-alertmanager-main-db\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.709747 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.709688    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.709865 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.709767    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-volume" (OuterVolumeSpecName: "config-volume") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.710078 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.710054    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-out" (OuterVolumeSpecName: "config-out") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:36.710170 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.710070    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.710545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.710498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:36.710545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.710499    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-kube-api-access-h9gnb" (OuterVolumeSpecName: "kube-api-access-h9gnb") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "kube-api-access-h9gnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:36.710858 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.710829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.711353 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.711337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.714924 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.714895    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.721952 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.721917    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-web-config" (OuterVolumeSpecName: "web-config") pod "24b4c6d8-2478-426a-80f8-cb08eb059b30" (UID: "24b4c6d8-2478-426a-80f8-cb08eb059b30"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:36.808916 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808866    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-web-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.808916 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808905    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-out\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.808916 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808922    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808935    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-tls-assets\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808946    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-config-volume\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808958    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808971    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9gnb\" (UniqueName: \"kubernetes.io/projected/24b4c6d8-2478-426a-80f8-cb08eb059b30-kube-api-access-h9gnb\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808984    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.808997    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-secret-alertmanager-main-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:36.809175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:36.809008    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b4c6d8-2478-426a-80f8-cb08eb059b30-cluster-tls-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:15:37.032008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.031904    2563 generic.go:356] "Generic (PLEG): container finished" podID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerID="d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d" exitCode=0
Jul 29 01:15:37.032008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.031983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d"}
Jul 29 01:15:37.032259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.032022    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.032259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.032074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b4c6d8-2478-426a-80f8-cb08eb059b30","Type":"ContainerDied","Data":"d9228b375ad0e194f110c12dbf60c0ecb39a549f0012fd9ad809efcdbad0e19e"}
Jul 29 01:15:37.032259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.032108    2563 scope.go:117] "RemoveContainer" containerID="b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741"
Jul 29 01:15:37.040318 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.040292    2563 scope.go:117] "RemoveContainer" containerID="c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72"
Jul 29 01:15:37.048053 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.048029    2563 scope.go:117] "RemoveContainer" containerID="60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250"
Jul 29 01:15:37.056165 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.056139    2563 scope.go:117] "RemoveContainer" containerID="d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d"
Jul 29 01:15:37.056553 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.056531    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:37.061103 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.061075    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:37.064518 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.064491    2563 scope.go:117] "RemoveContainer" containerID="0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f"
Jul 29 01:15:37.071976 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.071956    2563 scope.go:117] "RemoveContainer" containerID="e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343"
Jul 29 01:15:37.080024 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.079997    2563 scope.go:117] "RemoveContainer" containerID="65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4"
Jul 29 01:15:37.087757 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.087727    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088020    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-web"
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088032    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-web"
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088045    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="alertmanager"
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088051    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="alertmanager"
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088063    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="config-reloader"
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088069    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="config-reloader"
Jul 29 01:15:37.088076 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088075    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088081    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088088    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="init-config-reloader"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="init-config-reloader"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088120    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088126    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088135    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-metric"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088140    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-metric"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088147    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="prom-label-proxy"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088152    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="prom-label-proxy"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088197    2563 scope.go:117] "RemoveContainer" containerID="b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088223    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="alertmanager"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088234    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-metric"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088241    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy-web"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088252    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="kube-rbac-proxy"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088262    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7a5ab5-7b89-4a33-8191-6054ffb58d75" containerName="registry"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088271    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="prom-label-proxy"
Jul 29 01:15:37.088411 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088277    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" containerName="config-reloader"
Jul 29 01:15:37.088961 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.088585    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741\": container with ID starting with b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741 not found: ID does not exist" containerID="b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741"
Jul 29 01:15:37.088961 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088613    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741"} err="failed to get container status \"b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741\": rpc error: code = NotFound desc = could not find container \"b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741\": container with ID starting with b83b08d62e613a4d6d58afb306eccec869a8b1663b8b18e48ff2c214e9ea7741 not found: ID does not exist"
Jul 29 01:15:37.088961 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088635    2563 scope.go:117] "RemoveContainer" containerID="c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72"
Jul 29 01:15:37.088961 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.088907    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72\": container with ID starting with c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72 not found: ID does not exist" containerID="c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72"
Jul 29 01:15:37.088961 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088935    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72"} err="failed to get container status \"c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72\": rpc error: code = NotFound desc = could not find container \"c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72\": container with ID starting with c62c078a0a4f493c4514944df45b6561934c25db76a2e8e0756e3b44331abb72 not found: ID does not exist"
Jul 29 01:15:37.088961 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.088957    2563 scope.go:117] "RemoveContainer" containerID="60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250"
Jul 29 01:15:37.089238 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.089217    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250\": container with ID starting with 60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250 not found: ID does not exist" containerID="60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250"
Jul 29 01:15:37.089282 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.089245    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250"} err="failed to get container status \"60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250\": rpc error: code = NotFound desc = could not find container \"60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250\": container with ID starting with 60dd99bc79b1a327a20abd1ef91eaff47995ed5fd42ecac34a4544c8be8de250 not found: ID does not exist"
Jul 29 01:15:37.089282 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.089264    2563 scope.go:117] "RemoveContainer" containerID="d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d"
Jul 29 01:15:37.089536 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.089513    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d\": container with ID starting with d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d not found: ID does not exist" containerID="d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d"
Jul 29 01:15:37.089649 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.089540    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d"} err="failed to get container status \"d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d\": rpc error: code = NotFound desc = could not find container \"d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d\": container with ID starting with d18ed033f1148e7e70ec06b3ac6ea2cbb1870995ec463ed87c4f6550220aa35d not found: ID does not exist"
Jul 29 01:15:37.089649 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.089562    2563 scope.go:117] "RemoveContainer" containerID="0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f"
Jul 29 01:15:37.089892 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.089866    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f\": container with ID starting with 0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f not found: ID does not exist" containerID="0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f"
Jul 29 01:15:37.090020 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.089899    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f"} err="failed to get container status \"0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f\": rpc error: code = NotFound desc = could not find container \"0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f\": container with ID starting with 0ba367f83017d08b2f542958ae4d9de394211a90f0507ca6a165507a1f09737f not found: ID does not exist"
Jul 29 01:15:37.090020 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.089922    2563 scope.go:117] "RemoveContainer" containerID="e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343"
Jul 29 01:15:37.090171 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.090153    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343\": container with ID starting with e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343 not found: ID does not exist" containerID="e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343"
Jul 29 01:15:37.090230 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.090175    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343"} err="failed to get container status \"e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343\": rpc error: code = NotFound desc = could not find container \"e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343\": container with ID starting with e89585c7e44276be411a3f21c8ca2cc26b389ce3411225d40485d7e7f3290343 not found: ID does not exist"
Jul 29 01:15:37.090230 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.090209    2563 scope.go:117] "RemoveContainer" containerID="65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4"
Jul 29 01:15:37.090483 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:15:37.090464    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4\": container with ID starting with 65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4 not found: ID does not exist" containerID="65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4"
Jul 29 01:15:37.090537 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.090487    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4"} err="failed to get container status \"65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4\": rpc error: code = NotFound desc = could not find container \"65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4\": container with ID starting with 65edc46eb948d8aa95e2b20b1228f900b2bbb1ff4bde3457af59d352e10c4da4 not found: ID does not exist"
Jul 29 01:15:37.094277 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.094252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.096568 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.096543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 01:15:37.096694 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.096647    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 01:15:37.096801 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.096776    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 01:15:37.096909 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.096779    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 01:15:37.096909 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.096815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 01:15:37.097100 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.097081    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 01:15:37.097197 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.097164    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 01:15:37.097265 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.097236    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 01:15:37.097431 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.097415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qpbp7\""
Jul 29 01:15:37.102704 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.102681    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 01:15:37.105997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.105966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:37.213134 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7df682a0-4dab-4bea-9654-9ed313b2a401-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213134 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vr6v\" (UniqueName: \"kubernetes.io/projected/7df682a0-4dab-4bea-9654-9ed313b2a401-kube-api-access-9vr6v\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213367 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-config-volume\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213367 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213367 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7df682a0-4dab-4bea-9654-9ed313b2a401-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213367 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df682a0-4dab-4bea-9654-9ed313b2a401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213491 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213491 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213491 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df682a0-4dab-4bea-9654-9ed313b2a401-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213622 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7df682a0-4dab-4bea-9654-9ed313b2a401-config-out\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213622 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-web-config\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213622 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.213622 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.213608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314546 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-config-volume\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314546 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314546 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7df682a0-4dab-4bea-9654-9ed313b2a401-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314546 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df682a0-4dab-4bea-9654-9ed313b2a401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df682a0-4dab-4bea-9654-9ed313b2a401-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7df682a0-4dab-4bea-9654-9ed313b2a401-config-out\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-web-config\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.314842 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7df682a0-4dab-4bea-9654-9ed313b2a401-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.315268 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vr6v\" (UniqueName: \"kubernetes.io/projected/7df682a0-4dab-4bea-9654-9ed313b2a401-kube-api-access-9vr6v\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.315268 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.314998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7df682a0-4dab-4bea-9654-9ed313b2a401-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.315792 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.315763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df682a0-4dab-4bea-9654-9ed313b2a401-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.316362 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.316327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df682a0-4dab-4bea-9654-9ed313b2a401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.317826 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.317797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.317935 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.317798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.317935 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.317842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.317935 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.317857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-config-volume\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.318118 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.317989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.318173 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.318142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.318650 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.318622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7df682a0-4dab-4bea-9654-9ed313b2a401-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.318733 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.318707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7df682a0-4dab-4bea-9654-9ed313b2a401-config-out\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.319701 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.319683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7df682a0-4dab-4bea-9654-9ed313b2a401-web-config\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.322176 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.322156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vr6v\" (UniqueName: \"kubernetes.io/projected/7df682a0-4dab-4bea-9654-9ed313b2a401-kube-api-access-9vr6v\") pod \"alertmanager-main-0\" (UID: \"7df682a0-4dab-4bea-9654-9ed313b2a401\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.405180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.405141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:37.543822 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.543783    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24b4c6d8-2478-426a-80f8-cb08eb059b30" path="/var/lib/kubelet/pods/24b4c6d8-2478-426a-80f8-cb08eb059b30/volumes"
Jul 29 01:15:37.551964 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:37.551839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:37.554380 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:15:37.554350    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df682a0_4dab_4bea_9654_9ed313b2a401.slice/crio-e2130af82296fedad85f134c018f1bad58ad019da5c3b097c2e499f484fa9c64 WatchSource:0}: Error finding container e2130af82296fedad85f134c018f1bad58ad019da5c3b097c2e499f484fa9c64: Status 404 returned error can't find the container with id e2130af82296fedad85f134c018f1bad58ad019da5c3b097c2e499f484fa9c64
Jul 29 01:15:38.038410 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:38.038375    2563 generic.go:356] "Generic (PLEG): container finished" podID="7df682a0-4dab-4bea-9654-9ed313b2a401" containerID="03690af938385db90715a89910df25c531692e4a45b1f255e937059ce5840715" exitCode=0
Jul 29 01:15:38.038875 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:38.038462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerDied","Data":"03690af938385db90715a89910df25c531692e4a45b1f255e937059ce5840715"}
Jul 29 01:15:38.038875 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:38.038538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"e2130af82296fedad85f134c018f1bad58ad019da5c3b097c2e499f484fa9c64"}
Jul 29 01:15:39.048285 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.048238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"4f4b2238d45ee6b420fff81cc943b3d554d99f4044f5fed69716629f4cc54df6"}
Jul 29 01:15:39.048715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.048369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"208ef64e730eee972345aed9e578573050352d8b19f4b11aa68f0ffb885bbda4"}
Jul 29 01:15:39.048715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.048417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"b0331e7aa73a75b29f77220981bcdb0b6087dc92f11140a6e9249a1ff1e40671"}
Jul 29 01:15:39.048715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.048453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"c43019a7d4acc1924e52a71f97f879a46aba8d2793f4734299d6189c46bd4d78"}
Jul 29 01:15:39.048715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.048487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"ed6d67dd0d6ed21b6cc7eb356886b1281a20277d334f42fb10c86ed6dbf1b414"}
Jul 29 01:15:39.048715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.048522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7df682a0-4dab-4bea-9654-9ed313b2a401","Type":"ContainerStarted","Data":"0b699181fd8614634eaa1cec4ee446cac3f6efc474606aa9aa398db8c914a2a5"}
Jul 29 01:15:39.077404 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:39.077303    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.061015585 podStartE2EDuration="2.077279789s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.264204ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:39.075663076 +0000 UTC m=+384.037660097" watchObservedRunningTime="2026-07-29 01:15:39.077279789 +0000 UTC m=+384.039276801"
Jul 29 01:15:54.327805 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:15:54.327763    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f85dbcd7-fbkcx"]
Jul 29 01:16:19.349337 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.349272    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67f85dbcd7-fbkcx" podUID="3744bb5b-cb7a-4682-9e44-2ad31f081ad1" containerName="console" containerID="cri-o://84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859" gracePeriod=15
Jul 29 01:16:19.603543 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.603471    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:16:19.668158 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-trusted-ca-bundle\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668158 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668162    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-oauth-config\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668409 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668211    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-serving-cert\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668409 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-oauth-serving-cert\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668409 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668291    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-config\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668409 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668335    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztpc4\" (UniqueName: \"kubernetes.io/projected/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-kube-api-access-ztpc4\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668409 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668381    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-service-ca\") pod \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\" (UID: \"3744bb5b-cb7a-4682-9e44-2ad31f081ad1\") "
Jul 29 01:16:19.668721 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668683    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:19.668840 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668808    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:19.668903 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-config" (OuterVolumeSpecName: "console-config") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:19.668942 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.668924    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-service-ca" (OuterVolumeSpecName: "service-ca") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:19.670615 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.670591    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:19.670615 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.670604    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:19.670767 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.670628    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-kube-api-access-ztpc4" (OuterVolumeSpecName: "kube-api-access-ztpc4") pod "3744bb5b-cb7a-4682-9e44-2ad31f081ad1" (UID: "3744bb5b-cb7a-4682-9e44-2ad31f081ad1"). InnerVolumeSpecName "kube-api-access-ztpc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:16:19.769715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769670    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-trusted-ca-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:19.769715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769707    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-oauth-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:19.769715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769716    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:19.769715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769727    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-oauth-serving-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:19.769988 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769736    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-console-config\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:19.769988 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769744    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztpc4\" (UniqueName: \"kubernetes.io/projected/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-kube-api-access-ztpc4\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:19.769988 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:19.769753    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3744bb5b-cb7a-4682-9e44-2ad31f081ad1-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:20.219081 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.219043    2563 generic.go:356] "Generic (PLEG): container finished" podID="3744bb5b-cb7a-4682-9e44-2ad31f081ad1" containerID="84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859" exitCode=0
Jul 29 01:16:20.219303 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.219092    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f85dbcd7-fbkcx"
Jul 29 01:16:20.219303 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.219127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f85dbcd7-fbkcx" event={"ID":"3744bb5b-cb7a-4682-9e44-2ad31f081ad1","Type":"ContainerDied","Data":"84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859"}
Jul 29 01:16:20.219303 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.219180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f85dbcd7-fbkcx" event={"ID":"3744bb5b-cb7a-4682-9e44-2ad31f081ad1","Type":"ContainerDied","Data":"4265f01e971da42c49f968fb02c4f4237a61fae8b2cd1b1bc9c71552095ed251"}
Jul 29 01:16:20.219303 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.219214    2563 scope.go:117] "RemoveContainer" containerID="84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859"
Jul 29 01:16:20.228579 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.228559    2563 scope.go:117] "RemoveContainer" containerID="84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859"
Jul 29 01:16:20.228917 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:16:20.228895    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859\": container with ID starting with 84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859 not found: ID does not exist" containerID="84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859"
Jul 29 01:16:20.228990 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.228925    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859"} err="failed to get container status \"84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859\": rpc error: code = NotFound desc = could not find container \"84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859\": container with ID starting with 84d5881235595d6389102c66617d52e5c39fb300461fe410591ea3819c416859 not found: ID does not exist"
Jul 29 01:16:20.239629 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.239594    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f85dbcd7-fbkcx"]
Jul 29 01:16:20.245136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:20.245107    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f85dbcd7-fbkcx"]
Jul 29 01:16:21.543585 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:21.543549    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3744bb5b-cb7a-4682-9e44-2ad31f081ad1" path="/var/lib/kubelet/pods/3744bb5b-cb7a-4682-9e44-2ad31f081ad1/volumes"
Jul 29 01:16:40.078042 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.077952    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"]
Jul 29 01:16:40.078466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.078287    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3744bb5b-cb7a-4682-9e44-2ad31f081ad1" containerName="console"
Jul 29 01:16:40.078466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.078299    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3744bb5b-cb7a-4682-9e44-2ad31f081ad1" containerName="console"
Jul 29 01:16:40.078466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.078356    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3744bb5b-cb7a-4682-9e44-2ad31f081ad1" containerName="console"
Jul 29 01:16:40.081603 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.081583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.084718 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.084689    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 01:16:40.084936 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.084923    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r9r48\""
Jul 29 01:16:40.084996 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.084937    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 01:16:40.097130 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.097098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"]
Jul 29 01:16:40.145849 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.145806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4645\" (UniqueName: \"kubernetes.io/projected/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-kube-api-access-c4645\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.146006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.145858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.146006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.145945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.246710 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.246671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4645\" (UniqueName: \"kubernetes.io/projected/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-kube-api-access-c4645\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.246710 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.246718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.246935 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.246748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.247168 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.247148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.247235 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.247155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.273796 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.273756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4645\" (UniqueName: \"kubernetes.io/projected/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-kube-api-access-c4645\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.391036 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.390992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:40.536056 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.536018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"]
Jul 29 01:16:40.540089 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:16:40.540053    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9e46ee_ac17_4915_b6fd_6baaf61bf1fa.slice/crio-0aa8b650f79cfc4bc35a140fe971960e772b82f39f86b34194ed66cc1c9ef213 WatchSource:0}: Error finding container 0aa8b650f79cfc4bc35a140fe971960e772b82f39f86b34194ed66cc1c9ef213: Status 404 returned error can't find the container with id 0aa8b650f79cfc4bc35a140fe971960e772b82f39f86b34194ed66cc1c9ef213
Jul 29 01:16:40.545000 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.544969    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mkbbc"]
Jul 29 01:16:40.549696 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.549672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.552474 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.552446    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 01:16:40.552610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.552500    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 01:16:40.552610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.552504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pl2l8\""
Jul 29 01:16:40.561774 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.561743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mkbbc"]
Jul 29 01:16:40.650212 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.650080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85fa1c11-1298-4e51-bc30-1a9245c3f15b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mkbbc\" (UID: \"85fa1c11-1298-4e51-bc30-1a9245c3f15b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.650212 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.650121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvvqg\" (UniqueName: \"kubernetes.io/projected/85fa1c11-1298-4e51-bc30-1a9245c3f15b-kube-api-access-pvvqg\") pod \"cert-manager-webhook-6486ffd997-mkbbc\" (UID: \"85fa1c11-1298-4e51-bc30-1a9245c3f15b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.750991 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.750948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85fa1c11-1298-4e51-bc30-1a9245c3f15b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mkbbc\" (UID: \"85fa1c11-1298-4e51-bc30-1a9245c3f15b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.750991 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.750991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvvqg\" (UniqueName: \"kubernetes.io/projected/85fa1c11-1298-4e51-bc30-1a9245c3f15b-kube-api-access-pvvqg\") pod \"cert-manager-webhook-6486ffd997-mkbbc\" (UID: \"85fa1c11-1298-4e51-bc30-1a9245c3f15b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.758987 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.758959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85fa1c11-1298-4e51-bc30-1a9245c3f15b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mkbbc\" (UID: \"85fa1c11-1298-4e51-bc30-1a9245c3f15b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.759138 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.759120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvvqg\" (UniqueName: \"kubernetes.io/projected/85fa1c11-1298-4e51-bc30-1a9245c3f15b-kube-api-access-pvvqg\") pod \"cert-manager-webhook-6486ffd997-mkbbc\" (UID: \"85fa1c11-1298-4e51-bc30-1a9245c3f15b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:40.866591 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:40.866545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:41.000545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:41.000510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mkbbc"]
Jul 29 01:16:41.003645 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:16:41.003606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85fa1c11_1298_4e51_bc30_1a9245c3f15b.slice/crio-b96a5a3ebec76bec97a4c3fbb9d6343cab2d100b02301ecbdb13effa3da858c6 WatchSource:0}: Error finding container b96a5a3ebec76bec97a4c3fbb9d6343cab2d100b02301ecbdb13effa3da858c6: Status 404 returned error can't find the container with id b96a5a3ebec76bec97a4c3fbb9d6343cab2d100b02301ecbdb13effa3da858c6
Jul 29 01:16:41.307347 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:41.307221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc" event={"ID":"85fa1c11-1298-4e51-bc30-1a9245c3f15b","Type":"ContainerStarted","Data":"b96a5a3ebec76bec97a4c3fbb9d6343cab2d100b02301ecbdb13effa3da858c6"}
Jul 29 01:16:41.308791 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:41.308752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv" event={"ID":"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa","Type":"ContainerStarted","Data":"0aa8b650f79cfc4bc35a140fe971960e772b82f39f86b34194ed66cc1c9ef213"}
Jul 29 01:16:43.741453 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.741409    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"]
Jul 29 01:16:43.750991 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.750932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:43.753251 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.753208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"]
Jul 29 01:16:43.754652 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.754321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z68hs\""
Jul 29 01:16:43.880379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.880326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmv75\" (UniqueName: \"kubernetes.io/projected/b81d0bbb-e44f-4c53-9a64-005436a740c4-kube-api-access-vmv75\") pod \"cert-manager-cainjector-559cdd8c87-xmwv6\" (UID: \"b81d0bbb-e44f-4c53-9a64-005436a740c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:43.880574 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.880496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b81d0bbb-e44f-4c53-9a64-005436a740c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xmwv6\" (UID: \"b81d0bbb-e44f-4c53-9a64-005436a740c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:43.982064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.982001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b81d0bbb-e44f-4c53-9a64-005436a740c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xmwv6\" (UID: \"b81d0bbb-e44f-4c53-9a64-005436a740c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:43.982304 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.982104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmv75\" (UniqueName: \"kubernetes.io/projected/b81d0bbb-e44f-4c53-9a64-005436a740c4-kube-api-access-vmv75\") pod \"cert-manager-cainjector-559cdd8c87-xmwv6\" (UID: \"b81d0bbb-e44f-4c53-9a64-005436a740c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:43.999459 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.998741    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b81d0bbb-e44f-4c53-9a64-005436a740c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xmwv6\" (UID: \"b81d0bbb-e44f-4c53-9a64-005436a740c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:43.999459 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:43.999390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmv75\" (UniqueName: \"kubernetes.io/projected/b81d0bbb-e44f-4c53-9a64-005436a740c4-kube-api-access-vmv75\") pod \"cert-manager-cainjector-559cdd8c87-xmwv6\" (UID: \"b81d0bbb-e44f-4c53-9a64-005436a740c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:44.066091 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:44.066049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"
Jul 29 01:16:47.011252 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.011209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6"]
Jul 29 01:16:47.063257 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:16:47.063217    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb81d0bbb_e44f_4c53_9a64_005436a740c4.slice/crio-a352a0a4b746662c65c726b13881ebac543a1a4ea2c95b366c018ac587e8988a WatchSource:0}: Error finding container a352a0a4b746662c65c726b13881ebac543a1a4ea2c95b366c018ac587e8988a: Status 404 returned error can't find the container with id a352a0a4b746662c65c726b13881ebac543a1a4ea2c95b366c018ac587e8988a
Jul 29 01:16:47.346585 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.346537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6" event={"ID":"b81d0bbb-e44f-4c53-9a64-005436a740c4","Type":"ContainerStarted","Data":"3625274f8d78817c5f8d48b441dca101fc872f736ab25dd23b496aa8a24b2bc8"}
Jul 29 01:16:47.346797 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.346601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6" event={"ID":"b81d0bbb-e44f-4c53-9a64-005436a740c4","Type":"ContainerStarted","Data":"a352a0a4b746662c65c726b13881ebac543a1a4ea2c95b366c018ac587e8988a"}
Jul 29 01:16:47.348255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.348222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc" event={"ID":"85fa1c11-1298-4e51-bc30-1a9245c3f15b","Type":"ContainerStarted","Data":"ed488545d58425dd22cee5635ad30e422636182ea4d7fa24ac38638a1af3dc4a"}
Jul 29 01:16:47.348399 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.348313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:47.349843 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.349821    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerID="aac16470de62c96cb122360c4ecf2575d82b273ecfc0c98c8a72ea7c0c59c7d2" exitCode=0
Jul 29 01:16:47.350246 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.349868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv" event={"ID":"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa","Type":"ContainerDied","Data":"aac16470de62c96cb122360c4ecf2575d82b273ecfc0c98c8a72ea7c0c59c7d2"}
Jul 29 01:16:47.367633 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.367567    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xmwv6" podStartSLOduration=4.367544408 podStartE2EDuration="4.367544408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:47.366631913 +0000 UTC m=+452.328628921" watchObservedRunningTime="2026-07-29 01:16:47.367544408 +0000 UTC m=+452.329541407"
Jul 29 01:16:47.400044 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:47.399984    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc" podStartSLOduration=1.550741474 podStartE2EDuration="7.399966506s" totalImagesPullingTime="5.849225032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:47.39859684 +0000 UTC m=+452.360593848" watchObservedRunningTime="2026-07-29 01:16:47.399966506 +0000 UTC m=+452.361963512"
Jul 29 01:16:50.367688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:50.367651    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerID="804f403f0472878d718e1b11870faf63f1226a1fe17f6e8f7949085740971347" exitCode=0
Jul 29 01:16:50.368081 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:50.367712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv" event={"ID":"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa","Type":"ContainerDied","Data":"804f403f0472878d718e1b11870faf63f1226a1fe17f6e8f7949085740971347"}
Jul 29 01:16:53.359120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:53.359084    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mkbbc"
Jul 29 01:16:57.407715 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:57.407670    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerID="c89cc5a4993ff5832bb98c5e2e540e97edf3609b9d5492c2d86bfe3ae6b24f20" exitCode=0
Jul 29 01:16:57.408107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:57.407744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv" event={"ID":"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa","Type":"ContainerDied","Data":"c89cc5a4993ff5832bb98c5e2e540e97edf3609b9d5492c2d86bfe3ae6b24f20"}
Jul 29 01:16:58.548731 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.548692    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:58.712527 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.712420    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-util\") pod \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") "
Jul 29 01:16:58.712527 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.712495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4645\" (UniqueName: \"kubernetes.io/projected/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-kube-api-access-c4645\") pod \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") "
Jul 29 01:16:58.712527 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.712519    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-bundle\") pod \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\" (UID: \"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa\") "
Jul 29 01:16:58.712947 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.712915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-bundle" (OuterVolumeSpecName: "bundle") pod "5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" (UID: "5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:16:58.714863 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.714836    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-kube-api-access-c4645" (OuterVolumeSpecName: "kube-api-access-c4645") pod "5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" (UID: "5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa"). InnerVolumeSpecName "kube-api-access-c4645". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:16:58.716537 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.716513    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-util" (OuterVolumeSpecName: "util") pod "5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" (UID: "5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:16:58.813273 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.813234    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4645\" (UniqueName: \"kubernetes.io/projected/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-kube-api-access-c4645\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:58.813273 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.813267    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-bundle\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:58.813273 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:58.813276    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa-util\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:16:59.418410 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:59.418363    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv" event={"ID":"5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa","Type":"ContainerDied","Data":"0aa8b650f79cfc4bc35a140fe971960e772b82f39f86b34194ed66cc1c9ef213"}
Jul 29 01:16:59.418410 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:59.418400    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxgshv"
Jul 29 01:16:59.418627 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:16:59.418458    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aa8b650f79cfc4bc35a140fe971960e772b82f39f86b34194ed66cc1c9ef213"
Jul 29 01:17:05.280720 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.280681    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"]
Jul 29 01:17:05.281331 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281283    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="pull"
Jul 29 01:17:05.281331 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281305    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="pull"
Jul 29 01:17:05.281467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281352    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="util"
Jul 29 01:17:05.281467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281360    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="util"
Jul 29 01:17:05.281467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281371    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="extract"
Jul 29 01:17:05.281467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281381    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="extract"
Jul 29 01:17:05.281467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.281457    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a9e46ee-ac17-4915-b6fd-6baaf61bf1fa" containerName="extract"
Jul 29 01:17:05.353879 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.353834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"]
Jul 29 01:17:05.354079 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.353964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.356425 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.356396    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:17:05.357121 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.357106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jbmvz\""
Jul 29 01:17:05.357223 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.357202    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 01:17:05.466124 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.466086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67edabd3-a29f-4cd1-ae20-8333194bd865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8kzgk\" (UID: \"67edabd3-a29f-4cd1-ae20-8333194bd865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.466333 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.466155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxt2t\" (UniqueName: \"kubernetes.io/projected/67edabd3-a29f-4cd1-ae20-8333194bd865-kube-api-access-nxt2t\") pod \"openshift-lws-operator-fd8ccff4c-8kzgk\" (UID: \"67edabd3-a29f-4cd1-ae20-8333194bd865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.566946 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.566850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxt2t\" (UniqueName: \"kubernetes.io/projected/67edabd3-a29f-4cd1-ae20-8333194bd865-kube-api-access-nxt2t\") pod \"openshift-lws-operator-fd8ccff4c-8kzgk\" (UID: \"67edabd3-a29f-4cd1-ae20-8333194bd865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.566946 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.566916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67edabd3-a29f-4cd1-ae20-8333194bd865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8kzgk\" (UID: \"67edabd3-a29f-4cd1-ae20-8333194bd865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.567300 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.567278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67edabd3-a29f-4cd1-ae20-8333194bd865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8kzgk\" (UID: \"67edabd3-a29f-4cd1-ae20-8333194bd865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.575532 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.575510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxt2t\" (UniqueName: \"kubernetes.io/projected/67edabd3-a29f-4cd1-ae20-8333194bd865-kube-api-access-nxt2t\") pod \"openshift-lws-operator-fd8ccff4c-8kzgk\" (UID: \"67edabd3-a29f-4cd1-ae20-8333194bd865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.663242 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.663167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"
Jul 29 01:17:05.820752 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:05.820655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk"]
Jul 29 01:17:05.824158 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:17:05.824125    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67edabd3_a29f_4cd1_ae20_8333194bd865.slice/crio-95fcca38fcb27258c95b7082e19cf3e67d5a840442c11667deb2f07b5ed8e651 WatchSource:0}: Error finding container 95fcca38fcb27258c95b7082e19cf3e67d5a840442c11667deb2f07b5ed8e651: Status 404 returned error can't find the container with id 95fcca38fcb27258c95b7082e19cf3e67d5a840442c11667deb2f07b5ed8e651
Jul 29 01:17:06.451063 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:06.451024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk" event={"ID":"67edabd3-a29f-4cd1-ae20-8333194bd865","Type":"ContainerStarted","Data":"95fcca38fcb27258c95b7082e19cf3e67d5a840442c11667deb2f07b5ed8e651"}
Jul 29 01:17:09.467373 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:09.467326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk" event={"ID":"67edabd3-a29f-4cd1-ae20-8333194bd865","Type":"ContainerStarted","Data":"bb64cde7525546eaaaf0c340f6bb9d04c626da340cba14d66e33b755f4607c75"}
Jul 29 01:17:09.484275 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:09.484215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kzgk" podStartSLOduration=1.777276841 podStartE2EDuration="4.484198362s" totalImagesPullingTime="2.706921521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:09.483021006 +0000 UTC m=+474.445018014" watchObservedRunningTime="2026-07-29 01:17:09.484198362 +0000 UTC m=+474.446195359"
Jul 29 01:17:25.920251 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.920212    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"]
Jul 29 01:17:25.923556 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.923532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:25.926020 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.925978    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:17:25.926306 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.926128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:17:25.926306 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.926291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vl6gp\""
Jul 29 01:17:25.926420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.926387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:17:25.926620 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.926604    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:17:25.948810 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:25.948769    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"]
Jul 29 01:17:26.031968 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.031928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d99a0fb-ec81-46d6-b188-b57e251739ca-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.032150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.031983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d99a0fb-ec81-46d6-b188-b57e251739ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.032150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.032045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d99a0fb-ec81-46d6-b188-b57e251739ca-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.032150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.032096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d99a0fb-ec81-46d6-b188-b57e251739ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.032150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.032118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42fqs\" (UniqueName: \"kubernetes.io/projected/3d99a0fb-ec81-46d6-b188-b57e251739ca-kube-api-access-42fqs\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.132598 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.132554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d99a0fb-ec81-46d6-b188-b57e251739ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.132598 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.132603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42fqs\" (UniqueName: \"kubernetes.io/projected/3d99a0fb-ec81-46d6-b188-b57e251739ca-kube-api-access-42fqs\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.132834 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.132632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d99a0fb-ec81-46d6-b188-b57e251739ca-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.132834 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.132658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d99a0fb-ec81-46d6-b188-b57e251739ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.132834 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.132691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d99a0fb-ec81-46d6-b188-b57e251739ca-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.133163 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.133129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d99a0fb-ec81-46d6-b188-b57e251739ca-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.135102 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.135076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d99a0fb-ec81-46d6-b188-b57e251739ca-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.135280 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.135259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d99a0fb-ec81-46d6-b188-b57e251739ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.135332 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.135312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d99a0fb-ec81-46d6-b188-b57e251739ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.140480 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.140447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42fqs\" (UniqueName: \"kubernetes.io/projected/3d99a0fb-ec81-46d6-b188-b57e251739ca-kube-api-access-42fqs\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-9njpd\" (UID: \"3d99a0fb-ec81-46d6-b188-b57e251739ca\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.234589 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.234493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:26.411959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.411930    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"]
Jul 29 01:17:26.414564 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:17:26.414529    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d99a0fb_ec81_46d6_b188_b57e251739ca.slice/crio-848c4a828050d336218ed337536d7805677d504c1bb587fc17a28adfd7879de1 WatchSource:0}: Error finding container 848c4a828050d336218ed337536d7805677d504c1bb587fc17a28adfd7879de1: Status 404 returned error can't find the container with id 848c4a828050d336218ed337536d7805677d504c1bb587fc17a28adfd7879de1
Jul 29 01:17:26.549005 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:26.548914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd" event={"ID":"3d99a0fb-ec81-46d6-b188-b57e251739ca","Type":"ContainerStarted","Data":"848c4a828050d336218ed337536d7805677d504c1bb587fc17a28adfd7879de1"}
Jul 29 01:17:29.572418 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:29.572368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd" event={"ID":"3d99a0fb-ec81-46d6-b188-b57e251739ca","Type":"ContainerStarted","Data":"0f7746fb9cf4758287fac1f19462b75a412c40f8acf197ba222eb73a42956d16"}
Jul 29 01:17:31.583722 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:31.583686    2563 generic.go:356] "Generic (PLEG): container finished" podID="3d99a0fb-ec81-46d6-b188-b57e251739ca" containerID="0f7746fb9cf4758287fac1f19462b75a412c40f8acf197ba222eb73a42956d16" exitCode=0
Jul 29 01:17:31.584123 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:31.583759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd" event={"ID":"3d99a0fb-ec81-46d6-b188-b57e251739ca","Type":"ContainerDied","Data":"0f7746fb9cf4758287fac1f19462b75a412c40f8acf197ba222eb73a42956d16"}
Jul 29 01:17:32.590889 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:32.590854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd" event={"ID":"3d99a0fb-ec81-46d6-b188-b57e251739ca","Type":"ContainerStarted","Data":"f2b4014e8653ce68c417ea15cdd924b71e92ae4cfd92ad57016dd3026e4fac2d"}
Jul 29 01:17:32.591360 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:32.591068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:32.614872 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:32.614813    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd" podStartSLOduration=2.986747394 podStartE2EDuration="7.61479686s" totalImagesPullingTime="3.484425346s" totalInitContainerRuntime="1.14362412s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:32.612846181 +0000 UTC m=+497.574843189" watchObservedRunningTime="2026-07-29 01:17:32.61479686 +0000 UTC m=+497.576793866"
Jul 29 01:17:43.597472 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:43.597439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-9njpd"
Jul 29 01:17:46.193202 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.193151    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bnsbx"]
Jul 29 01:17:46.197425 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.197403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.200590 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.200562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 01:17:46.201594 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.201573    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jn2l5\""
Jul 29 01:17:46.216170 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.216134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bnsbx"]
Jul 29 01:17:46.319636 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.319583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9975c4b5-754c-4fea-b382-1b9db1364c92-cert\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.319831 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.319658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9d7s\" (UniqueName: \"kubernetes.io/projected/9975c4b5-754c-4fea-b382-1b9db1364c92-kube-api-access-c9d7s\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.420772 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.420729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9975c4b5-754c-4fea-b382-1b9db1364c92-cert\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.420971 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.420800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9d7s\" (UniqueName: \"kubernetes.io/projected/9975c4b5-754c-4fea-b382-1b9db1364c92-kube-api-access-c9d7s\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.420971 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:17:46.420883    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 01:17:46.420971 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:17:46.420963    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9975c4b5-754c-4fea-b382-1b9db1364c92-cert podName:9975c4b5-754c-4fea-b382-1b9db1364c92 nodeName:}" failed. No retries permitted until 2026-07-29 01:17:46.920945119 +0000 UTC m=+511.882942108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9975c4b5-754c-4fea-b382-1b9db1364c92-cert") pod "odh-model-controller-7998c67dc4-bnsbx" (UID: "9975c4b5-754c-4fea-b382-1b9db1364c92") : secret "odh-model-controller-webhook-cert" not found
Jul 29 01:17:46.429550 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.429516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9d7s\" (UniqueName: \"kubernetes.io/projected/9975c4b5-754c-4fea-b382-1b9db1364c92-kube-api-access-c9d7s\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.926557 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.926517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9975c4b5-754c-4fea-b382-1b9db1364c92-cert\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:46.929108 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:46.929083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9975c4b5-754c-4fea-b382-1b9db1364c92-cert\") pod \"odh-model-controller-7998c67dc4-bnsbx\" (UID: \"9975c4b5-754c-4fea-b382-1b9db1364c92\") " pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:47.108894 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:47.108851    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:47.270116 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:47.270032    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bnsbx"]
Jul 29 01:17:47.273072 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:17:47.273047    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9975c4b5_754c_4fea_b382_1b9db1364c92.slice/crio-fd9255ca2df326dd63825d8db2406ef7ec0123b51c1afc0aeb6272812ecd5401 WatchSource:0}: Error finding container fd9255ca2df326dd63825d8db2406ef7ec0123b51c1afc0aeb6272812ecd5401: Status 404 returned error can't find the container with id fd9255ca2df326dd63825d8db2406ef7ec0123b51c1afc0aeb6272812ecd5401
Jul 29 01:17:47.660049 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:47.660012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx" event={"ID":"9975c4b5-754c-4fea-b382-1b9db1364c92","Type":"ContainerStarted","Data":"fd9255ca2df326dd63825d8db2406ef7ec0123b51c1afc0aeb6272812ecd5401"}
Jul 29 01:17:50.677735 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:50.677690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx" event={"ID":"9975c4b5-754c-4fea-b382-1b9db1364c92","Type":"ContainerStarted","Data":"13c4dcf0f9eb8622bcdb93d045dcc55d4dc26431a1209d3814e6963cecddb870"}
Jul 29 01:17:50.678138 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:50.677839    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:17:50.695296 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:50.695239    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx" podStartSLOduration=2.002058628 podStartE2EDuration="4.695223298s" totalImagesPullingTime="2.69316467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:50.693128721 +0000 UTC m=+515.655125728" watchObservedRunningTime="2026-07-29 01:17:50.695223298 +0000 UTC m=+515.657220353"
Jul 29 01:17:53.317784 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.317747    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"]
Jul 29 01:17:53.321497 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.321471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.324177 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.324156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:17:53.324423 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.324401    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nxw9n\""
Jul 29 01:17:53.324509 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.324422    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 01:17:53.324599 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.324583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:17:53.337968 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.337937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"]
Jul 29 01:17:53.389643 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.389821 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.389821 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.389899 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.389899 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.389899 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.390052 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7fv\" (UniqueName: \"kubernetes.io/projected/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-kube-api-access-jp7fv\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.390052 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.389976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.390052 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.390021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.490747 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7fv\" (UniqueName: \"kubernetes.io/projected/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-kube-api-access-jp7fv\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.490955 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.490955 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.490955 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.490955 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.490955 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.490974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491508 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491508 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491695 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491695 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.491783 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.491690    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.493374 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.493353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.493533 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.493515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.506722 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.506685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7fv\" (UniqueName: \"kubernetes.io/projected/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-kube-api-access-jp7fv\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.513688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.513660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55c64bf777bvnxg\" (UID: \"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.547852 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.547816    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"]
Jul 29 01:17:53.552315 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.552297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.555153 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.555122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 01:17:53.555280 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.555241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 01:17:53.556125 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.556102    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-95ltp\""
Jul 29 01:17:53.556125 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.556119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 01:17:53.570547 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.570485    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"]
Jul 29 01:17:53.591920 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.591883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa8c2abb-68e2-4366-aeff-b81d22318bdc-cert\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.592123 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.591965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa8c2abb-68e2-4366-aeff-b81d22318bdc-metrics-cert\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.592212 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.592159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa8c2abb-68e2-4366-aeff-b81d22318bdc-manager-config\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.592275 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.592238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwpzd\" (UniqueName: \"kubernetes.io/projected/fa8c2abb-68e2-4366-aeff-b81d22318bdc-kube-api-access-bwpzd\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.632501 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.632466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:53.700211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.695051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa8c2abb-68e2-4366-aeff-b81d22318bdc-manager-config\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.700211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.695129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwpzd\" (UniqueName: \"kubernetes.io/projected/fa8c2abb-68e2-4366-aeff-b81d22318bdc-kube-api-access-bwpzd\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.700211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.695168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa8c2abb-68e2-4366-aeff-b81d22318bdc-cert\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.700211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.695263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa8c2abb-68e2-4366-aeff-b81d22318bdc-metrics-cert\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.700211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.696389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa8c2abb-68e2-4366-aeff-b81d22318bdc-manager-config\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.704995 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.704925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa8c2abb-68e2-4366-aeff-b81d22318bdc-metrics-cert\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.706560 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.706533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa8c2abb-68e2-4366-aeff-b81d22318bdc-cert\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.711354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.711303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwpzd\" (UniqueName: \"kubernetes.io/projected/fa8c2abb-68e2-4366-aeff-b81d22318bdc-kube-api-access-bwpzd\") pod \"lws-controller-manager-588fcb66d4-b9lkd\" (UID: \"fa8c2abb-68e2-4366-aeff-b81d22318bdc\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:53.815517 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.815487    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"]
Jul 29 01:17:53.818319 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:17:53.818291    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e7593f_7b89_4ada_a5b7_2a9e2e3f40c5.slice/crio-1be163c1b631a796f93fcbae0e04149d06d8133e31511e587978f53d14687d28 WatchSource:0}: Error finding container 1be163c1b631a796f93fcbae0e04149d06d8133e31511e587978f53d14687d28: Status 404 returned error can't find the container with id 1be163c1b631a796f93fcbae0e04149d06d8133e31511e587978f53d14687d28
Jul 29 01:17:53.862557 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:53.862525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:54.046981 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.046947    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"]
Jul 29 01:17:54.050399 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:17:54.050369    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8c2abb_68e2_4366_aeff_b81d22318bdc.slice/crio-703ec88ea3e0aaf0452d7fab383032820d9cc96c8f08d1808115a0556f679c77 WatchSource:0}: Error finding container 703ec88ea3e0aaf0452d7fab383032820d9cc96c8f08d1808115a0556f679c77: Status 404 returned error can't find the container with id 703ec88ea3e0aaf0452d7fab383032820d9cc96c8f08d1808115a0556f679c77
Jul 29 01:17:54.467875 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.467831    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"]
Jul 29 01:17:54.471778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.471736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.474602 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.474564    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 01:17:54.474720 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.474653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-22gj9\""
Jul 29 01:17:54.477755 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.477710    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 01:17:54.477983 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.477968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 01:17:54.486892 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.486830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"]
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e15d4e-af88-4026-86d6-388ead5073bc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e15d4e-af88-4026-86d6-388ead5073bc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41e15d4e-af88-4026-86d6-388ead5073bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtj4z\" (UniqueName: \"kubernetes.io/projected/41e15d4e-af88-4026-86d6-388ead5073bc-kube-api-access-dtj4z\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.505255 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.502526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603575 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e15d4e-af88-4026-86d6-388ead5073bc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e15d4e-af88-4026-86d6-388ead5073bc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41e15d4e-af88-4026-86d6-388ead5073bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtj4z\" (UniqueName: \"kubernetes.io/projected/41e15d4e-af88-4026-86d6-388ead5073bc-kube-api-access-dtj4z\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.603778 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.603798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.604821 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.604767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41e15d4e-af88-4026-86d6-388ead5073bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.606612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.606583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e15d4e-af88-4026-86d6-388ead5073bc-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.607028 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.607000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.607274 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.607231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.607394 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.607335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41e15d4e-af88-4026-86d6-388ead5073bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.612277 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.612240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e15d4e-af88-4026-86d6-388ead5073bc-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.612632 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.612610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtj4z\" (UniqueName: \"kubernetes.io/projected/41e15d4e-af88-4026-86d6-388ead5073bc-kube-api-access-dtj4z\") pod \"istiod-openshift-gateway-5677ccb49b-snmbz\" (UID: \"41e15d4e-af88-4026-86d6-388ead5073bc\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:54.714644 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.714600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd" event={"ID":"fa8c2abb-68e2-4366-aeff-b81d22318bdc","Type":"ContainerStarted","Data":"703ec88ea3e0aaf0452d7fab383032820d9cc96c8f08d1808115a0556f679c77"}
Jul 29 01:17:54.716450 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.716416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg" event={"ID":"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5","Type":"ContainerStarted","Data":"1be163c1b631a796f93fcbae0e04149d06d8133e31511e587978f53d14687d28"}
Jul 29 01:17:54.795119 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:54.786644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:55.001218 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:55.001157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"]
Jul 29 01:17:55.188195 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:17:55.188133    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e15d4e_af88_4026_86d6_388ead5073bc.slice/crio-4e77d1f4bb4948ad25c27358c7cc78d29e38deefb57b23cac5c78d59c497c584 WatchSource:0}: Error finding container 4e77d1f4bb4948ad25c27358c7cc78d29e38deefb57b23cac5c78d59c497c584: Status 404 returned error can't find the container with id 4e77d1f4bb4948ad25c27358c7cc78d29e38deefb57b23cac5c78d59c497c584
Jul 29 01:17:55.724240 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:55.724207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz" event={"ID":"41e15d4e-af88-4026-86d6-388ead5073bc","Type":"ContainerStarted","Data":"4e77d1f4bb4948ad25c27358c7cc78d29e38deefb57b23cac5c78d59c497c584"}
Jul 29 01:17:56.731807 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:56.731765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd" event={"ID":"fa8c2abb-68e2-4366-aeff-b81d22318bdc","Type":"ContainerStarted","Data":"239646bc740aea3d85d89827467b2df7dc6a9fe4bd0abe982dd6f8a25218fbcf"}
Jul 29 01:17:56.732363 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:56.732052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:17:58.244700 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.244618    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:58.244700 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.244689    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:58.244980 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.244727    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:58.246163 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.246130    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:58.246308 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.246199    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:58.747356 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.747312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz" event={"ID":"41e15d4e-af88-4026-86d6-388ead5073bc","Type":"ContainerStarted","Data":"61927db6120d934be2475c82d1c2e9830fb501687f07ac80cd57528844473c1f"}
Jul 29 01:17:58.747550 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.747426    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:17:58.749092 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.749065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg" event={"ID":"d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5","Type":"ContainerStarted","Data":"3af3406a2130f9d9428b2fc5e2aa8e8731ffc73ed73b455f85b4fefd1dd1c010"}
Jul 29 01:17:58.786712 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.786651    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz" podStartSLOduration=1.731292856 podStartE2EDuration="4.786633794s" totalImagesPullingTime="3.055340938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:58.785893033 +0000 UTC m=+523.747890068" watchObservedRunningTime="2026-07-29 01:17:58.786633794 +0000 UTC m=+523.748630800"
Jul 29 01:17:58.787145 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.787123    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd" podStartSLOduration=4.171458916 podStartE2EDuration="5.78711698s" totalImagesPullingTime="1.615658064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:56.772623298 +0000 UTC m=+521.734620305" watchObservedRunningTime="2026-07-29 01:17:58.78711698 +0000 UTC m=+523.749113986"
Jul 29 01:17:58.807102 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:58.807037    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg" podStartSLOduration=1.3833754919999999 podStartE2EDuration="5.807012409s" totalImagesPullingTime="4.423636917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:58.806679764 +0000 UTC m=+523.768676785" watchObservedRunningTime="2026-07-29 01:17:58.807012409 +0000 UTC m=+523.769009417"
Jul 29 01:17:59.633179 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:59.633140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:59.641399 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:59.641366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:59.754360 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:59.754314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:59.755378 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:59.755355    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55c64bf777bvnxg"
Jul 29 01:17:59.756175 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:17:59.756149    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-snmbz"
Jul 29 01:18:01.684830 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:18:01.684790    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bnsbx"
Jul 29 01:18:07.743589 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:18:07.743550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-b9lkd"
Jul 29 01:19:15.579556 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:19:15.579450    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:19:15.586525 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:19:15.586498    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:20:18.958990 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:18.958956    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"]
Jul 29 01:20:18.962612 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:18.962588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:18.966546 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:18.966523    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j9v5k\""
Jul 29 01:20:18.981496 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:18.981453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"]
Jul 29 01:20:19.096331 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-credential-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096331 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-data\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04c49a4e-e76d-4069-8b66-3bec19bed147-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-workload-certs\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-envoy\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-workload-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096819 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ksd\" (UniqueName: \"kubernetes.io/projected/04c49a4e-e76d-4069-8b66-3bec19bed147-kube-api-access-k8ksd\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.096819 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.096707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-token\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197331 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-workload-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197331 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ksd\" (UniqueName: \"kubernetes.io/projected/04c49a4e-e76d-4069-8b66-3bec19bed147-kube-api-access-k8ksd\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-token\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-credential-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-data\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04c49a4e-e76d-4069-8b66-3bec19bed147-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-workload-certs\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197592 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-envoy\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-workload-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-credential-socket\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.197969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-data\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.198112 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.197969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-workload-certs\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.198177 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.198154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04c49a4e-e76d-4069-8b66-3bec19bed147-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.200158 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.200132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-envoy\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.200315 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.200297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.205816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.205784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04c49a4e-e76d-4069-8b66-3bec19bed147-istio-token\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.205977 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.205955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ksd\" (UniqueName: \"kubernetes.io/projected/04c49a4e-e76d-4069-8b66-3bec19bed147-kube-api-access-k8ksd\") pod \"maas-default-gateway-openshift-default-5fddf99bfd-vkjbr\" (UID: \"04c49a4e-e76d-4069-8b66-3bec19bed147\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.273061 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.272963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:19.411131 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.411102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"]
Jul 29 01:20:19.413477 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:20:19.413441    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c49a4e_e76d_4069_8b66_3bec19bed147.slice/crio-9265062b8ce3dc89eee1a54eac8da82a43914b3a0ac4fa3a6ded9b039dde28a1 WatchSource:0}: Error finding container 9265062b8ce3dc89eee1a54eac8da82a43914b3a0ac4fa3a6ded9b039dde28a1: Status 404 returned error can't find the container with id 9265062b8ce3dc89eee1a54eac8da82a43914b3a0ac4fa3a6ded9b039dde28a1
Jul 29 01:20:19.416026 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.415986    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:20:19.416095 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.416073    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:20:19.416140 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.416123    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:20:19.421831 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:19.421807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" event={"ID":"04c49a4e-e76d-4069-8b66-3bec19bed147","Type":"ContainerStarted","Data":"9265062b8ce3dc89eee1a54eac8da82a43914b3a0ac4fa3a6ded9b039dde28a1"}
Jul 29 01:20:20.427911 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:20.427871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" event={"ID":"04c49a4e-e76d-4069-8b66-3bec19bed147","Type":"ContainerStarted","Data":"ae20fa30ca12853e46749ad82ce0ae48949c917981b47f9e7da7468d5f65de11"}
Jul 29 01:20:20.449098 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:20.449045    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" podStartSLOduration=2.449027037 podStartE2EDuration="2.449027037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:20.446751788 +0000 UTC m=+665.408748796" watchObservedRunningTime="2026-07-29 01:20:20.449027037 +0000 UTC m=+665.411024044"
Jul 29 01:20:21.273524 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:21.273464    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:21.278428 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:21.278401    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:21.433168 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:21.433140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:20:21.434104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:20:21.434078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:21:38.394380 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.394336    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"]
Jul 29 01:21:38.398296 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.398265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.400583 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.400555    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 29 01:21:38.400714 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.400604    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:21:38.401249 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.401227    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:21:38.401316 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.401247    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7b9zw\""
Jul 29 01:21:38.408607 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.408578    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"]
Jul 29 01:21:38.516611 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.516560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/750763c2-aec0-475a-a191-b2024da1d8d9-maas-api-tls\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.516611 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.516604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgcf9\" (UniqueName: \"kubernetes.io/projected/750763c2-aec0-475a-a191-b2024da1d8d9-kube-api-access-vgcf9\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.516837 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.516682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/750763c2-aec0-475a-a191-b2024da1d8d9-openshift-service-ca\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.617855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.617813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/750763c2-aec0-475a-a191-b2024da1d8d9-maas-api-tls\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.617855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.617854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgcf9\" (UniqueName: \"kubernetes.io/projected/750763c2-aec0-475a-a191-b2024da1d8d9-kube-api-access-vgcf9\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.618136 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.617940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/750763c2-aec0-475a-a191-b2024da1d8d9-openshift-service-ca\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.618695 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.618670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/750763c2-aec0-475a-a191-b2024da1d8d9-openshift-service-ca\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.620471 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.620449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/750763c2-aec0-475a-a191-b2024da1d8d9-maas-api-tls\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.629128 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.629098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgcf9\" (UniqueName: \"kubernetes.io/projected/750763c2-aec0-475a-a191-b2024da1d8d9-kube-api-access-vgcf9\") pod \"maas-api-6fd655db7f-sblhm\" (UID: \"750763c2-aec0-475a-a191-b2024da1d8d9\") " pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.712092 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.711930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:38.860060 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.860028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"]
Jul 29 01:21:38.863253 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:21:38.863177    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750763c2_aec0_475a_a191_b2024da1d8d9.slice/crio-0fa2c6d462303ea8cbb0c4dbf4d34fcb220053924e3f828456a1b44f82c23d7a WatchSource:0}: Error finding container 0fa2c6d462303ea8cbb0c4dbf4d34fcb220053924e3f828456a1b44f82c23d7a: Status 404 returned error can't find the container with id 0fa2c6d462303ea8cbb0c4dbf4d34fcb220053924e3f828456a1b44f82c23d7a
Jul 29 01:21:38.864860 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:38.864833    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:21:39.821493 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:39.821446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm" event={"ID":"750763c2-aec0-475a-a191-b2024da1d8d9","Type":"ContainerStarted","Data":"0fa2c6d462303ea8cbb0c4dbf4d34fcb220053924e3f828456a1b44f82c23d7a"}
Jul 29 01:21:42.841267 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:42.841159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm" event={"ID":"750763c2-aec0-475a-a191-b2024da1d8d9","Type":"ContainerStarted","Data":"3bc5aa1dab9d61b81ab709434c0c8377f45738012a566c48325b9fc448275843"}
Jul 29 01:21:42.842396 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:42.842295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:42.859552 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:42.859480    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm" podStartSLOduration=1.838817124 podStartE2EDuration="4.859456087s" totalImagesPullingTime="3.020638963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:42.856765074 +0000 UTC m=+747.818762082" watchObservedRunningTime="2026-07-29 01:21:42.859456087 +0000 UTC m=+747.821453095"
Jul 29 01:21:46.873104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:46.873068    2563 generic.go:356] "Generic (PLEG): container finished" podID="04c49a4e-e76d-4069-8b66-3bec19bed147" containerID="ae20fa30ca12853e46749ad82ce0ae48949c917981b47f9e7da7468d5f65de11" exitCode=0
Jul 29 01:21:46.873554 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:46.873136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" event={"ID":"04c49a4e-e76d-4069-8b66-3bec19bed147","Type":"ContainerDied","Data":"ae20fa30ca12853e46749ad82ce0ae48949c917981b47f9e7da7468d5f65de11"}
Jul 29 01:21:46.873597 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:46.873578    2563 scope.go:117] "RemoveContainer" containerID="ae20fa30ca12853e46749ad82ce0ae48949c917981b47f9e7da7468d5f65de11"
Jul 29 01:21:46.874645 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:46.874616    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:21:46.874708 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:46.874693    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:21:46.874744 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:46.874726    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:21:47.880403 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:47.880363    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" event={"ID":"04c49a4e-e76d-4069-8b66-3bec19bed147","Type":"ContainerStarted","Data":"d22f7a5587d103f615bcd9efb0066bd81c0d59201426b7d0729c4ddd60046c16"}
Jul 29 01:21:48.273351 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:48.273236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:21:48.274572 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:48.274540    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:21:48.274697 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:48.274606    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" podUID="04c49a4e-e76d-4069-8b66-3bec19bed147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 01:21:48.862342 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:48.862311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6fd655db7f-sblhm"
Jul 29 01:21:49.273746 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:49.273704    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:21:49.274167 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:49.273805    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" podUID="04c49a4e-e76d-4069-8b66-3bec19bed147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 01:21:50.274282 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:50.274237    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:21:50.274711 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:50.274315    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" podUID="04c49a4e-e76d-4069-8b66-3bec19bed147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 01:21:51.274497 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:51.274452    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:21:51.274919 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:51.274547    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr" podUID="04c49a4e-e76d-4069-8b66-3bec19bed147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 29 01:21:51.433322 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:51.433278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:21:52.278461 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:52.278428    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:21:52.279661 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:21:52.279630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5fddf99bfd-vkjbr"
Jul 29 01:22:07.692020 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.691983    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"]
Jul 29 01:22:07.700614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.700580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.703954 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.703911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:22:07.704133 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.703970    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:22:07.704133 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.704041    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s5586\""
Jul 29 01:22:07.704133 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.704059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 01:22:07.706806 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.706772    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"]
Jul 29 01:22:07.819658 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.819595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.819658 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.819664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.819962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.819705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n98n2\" (UniqueName: \"kubernetes.io/projected/520791c7-3701-4546-b4b5-98307ebe35d0-kube-api-access-n98n2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.819962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.819743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/520791c7-3701-4546-b4b5-98307ebe35d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.819962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.819840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.819962 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.819887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.920788 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.920732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98n2\" (UniqueName: \"kubernetes.io/projected/520791c7-3701-4546-b4b5-98307ebe35d0-kube-api-access-n98n2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.920788 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.920802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/520791c7-3701-4546-b4b5-98307ebe35d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921098 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.920847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921098 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.920872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921098 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.920932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921098 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.920951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921342 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.921321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921426 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.921396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.921477 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.921426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.923401 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.923376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/520791c7-3701-4546-b4b5-98307ebe35d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.923604 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.923583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/520791c7-3701-4546-b4b5-98307ebe35d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:07.929977 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:07.929935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n98n2\" (UniqueName: \"kubernetes.io/projected/520791c7-3701-4546-b4b5-98307ebe35d0-kube-api-access-n98n2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf\" (UID: \"520791c7-3701-4546-b4b5-98307ebe35d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:08.014301 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:08.014170    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:08.165266 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:08.165233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"]
Jul 29 01:22:08.168051 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:22:08.168004    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520791c7_3701_4546_b4b5_98307ebe35d0.slice/crio-b2c44cdd76ea85003e5d7b8864d2db1d12d6e59c28c163b33acb292fc18dc606 WatchSource:0}: Error finding container b2c44cdd76ea85003e5d7b8864d2db1d12d6e59c28c163b33acb292fc18dc606: Status 404 returned error can't find the container with id b2c44cdd76ea85003e5d7b8864d2db1d12d6e59c28c163b33acb292fc18dc606
Jul 29 01:22:08.993107 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:08.993047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf" event={"ID":"520791c7-3701-4546-b4b5-98307ebe35d0","Type":"ContainerStarted","Data":"b2c44cdd76ea85003e5d7b8864d2db1d12d6e59c28c163b33acb292fc18dc606"}
Jul 29 01:22:09.999786 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:09.999747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf" event={"ID":"520791c7-3701-4546-b4b5-98307ebe35d0","Type":"ContainerStarted","Data":"77a91667d708cbd3a4f8cc96f4e368c3eebfbf2be2639bb773c0b90ff139210e"}
Jul 29 01:22:10.024071 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:10.024007    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf" podStartSLOduration=2.051153482 podStartE2EDuration="3.023985725s" totalImagesPullingTime="972.832243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:10.023518867 +0000 UTC m=+774.985515875" watchObservedRunningTime="2026-07-29 01:22:10.023985725 +0000 UTC m=+774.985982732"
Jul 29 01:22:18.015097 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:18.015039    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:18.015605 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:18.015123    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:18.028265 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:18.028234    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:22:18.051657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:22:18.051624    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf"
Jul 29 01:24:15.613676 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:24:15.613645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:24:15.619239 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:24:15.619217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:29:15.650159 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:29:15.650130    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:29:15.657419 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:29:15.657395    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:30:00.140499 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.140462    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"]
Jul 29 01:30:00.143724 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.143708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"
Jul 29 01:30:00.146278 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.146257    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:30:00.153151 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.153133    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"
Jul 29 01:30:00.162211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.162171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"]
Jul 29 01:30:00.285063 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.285033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"]
Jul 29 01:30:00.287858 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:30:00.287831    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8128a63e_f173_40ac_be25_9a2784f0bb33.slice/crio-bf1402e3e36e67e0d41ed1d110d5c57c96121ab666b4d9b1ee219e37e65edce4 WatchSource:0}: Error finding container bf1402e3e36e67e0d41ed1d110d5c57c96121ab666b4d9b1ee219e37e65edce4: Status 404 returned error can't find the container with id bf1402e3e36e67e0d41ed1d110d5c57c96121ab666b4d9b1ee219e37e65edce4
Jul 29 01:30:00.293032 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.292959    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:30:00.303851 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:00.303814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd" event={"ID":"8128a63e-f173-40ac-be25-9a2784f0bb33","Type":"ContainerStarted","Data":"bf1402e3e36e67e0d41ed1d110d5c57c96121ab666b4d9b1ee219e37e65edce4"}
Jul 29 01:30:04.324942 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:04.324909    2563 generic.go:356] "Generic (PLEG): container finished" podID="8128a63e-f173-40ac-be25-9a2784f0bb33" containerID="fd30a7fc4337c2987b1a21cb733cd55a03b49dc7842b84921f9b657227c5c9ba" exitCode=0
Jul 29 01:30:04.325356 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:04.324999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd" event={"ID":"8128a63e-f173-40ac-be25-9a2784f0bb33","Type":"ContainerDied","Data":"fd30a7fc4337c2987b1a21cb733cd55a03b49dc7842b84921f9b657227c5c9ba"}
Jul 29 01:30:05.461905 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:05.461881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"
Jul 29 01:30:06.336624 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:06.336598    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd"
Jul 29 01:30:06.336795 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:06.336589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-888sd" event={"ID":"8128a63e-f173-40ac-be25-9a2784f0bb33","Type":"ContainerDied","Data":"bf1402e3e36e67e0d41ed1d110d5c57c96121ab666b4d9b1ee219e37e65edce4"}
Jul 29 01:30:06.336795 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:30:06.336761    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf1402e3e36e67e0d41ed1d110d5c57c96121ab666b4d9b1ee219e37e65edce4"
Jul 29 01:34:15.680383 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:34:15.680268    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:34:15.687799 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:34:15.687780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:39:15.709222 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:15.709091    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:39:15.719083 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:15.719062    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:39:31.914755 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.914720    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"]
Jul 29 01:39:31.915233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.915108    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8128a63e-f173-40ac-be25-9a2784f0bb33" containerName="cleanup"
Jul 29 01:39:31.915233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.915120    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8128a63e-f173-40ac-be25-9a2784f0bb33" containerName="cleanup"
Jul 29 01:39:31.915233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.915211    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8128a63e-f173-40ac-be25-9a2784f0bb33" containerName="cleanup"
Jul 29 01:39:31.918428 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.918409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:31.920742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.920724    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9acc92f8-openshift-default-dockercfg-86htf\""
Jul 29 01:39:31.942876 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:31.942849    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"]
Jul 29 01:39:32.079470 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-podinfo\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079470 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5jm\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-kube-api-access-8z5jm\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079729 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-envoy\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079729 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-token\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079729 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-certs\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079729 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-data\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079912 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-credential-socket\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079912 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74e2328e-96da-4c78-b79c-3dc74b62f9af-istiod-ca-cert\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.079912 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.079800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-socket\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.180905 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.180820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-podinfo\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.180905 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.180865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5jm\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-kube-api-access-8z5jm\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.180958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-envoy\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.180987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-token\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-certs\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-data\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-credential-socket\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181404 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74e2328e-96da-4c78-b79c-3dc74b62f9af-istiod-ca-cert\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181404 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-socket\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181502 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-credential-socket\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181639 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-certs\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181706 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-socket\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181849 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-data\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.181912 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.181870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74e2328e-96da-4c78-b79c-3dc74b62f9af-istiod-ca-cert\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.183299 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.183279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-envoy\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.183493 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.183473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-podinfo\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.188803 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.188777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-token\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.189172 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.189153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5jm\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-kube-api-access-8z5jm\") pod \"e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") " pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.228208 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.228157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:32.364169 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.364143    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"]
Jul 29 01:39:32.366011 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:39:32.365984    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e2328e_96da_4c78_b79c_3dc74b62f9af.slice/crio-2cdb3f8e4c0bcacde1cec06b86c63155aecebdb83c55a6072d1118f0e6c08eb8 WatchSource:0}: Error finding container 2cdb3f8e4c0bcacde1cec06b86c63155aecebdb83c55a6072d1118f0e6c08eb8: Status 404 returned error can't find the container with id 2cdb3f8e4c0bcacde1cec06b86c63155aecebdb83c55a6072d1118f0e6c08eb8
Jul 29 01:39:32.368157 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.368119    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:39:32.368257 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.368206    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:39:32.368257 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:32.368240    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:39:33.086665 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:33.086628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" event={"ID":"74e2328e-96da-4c78-b79c-3dc74b62f9af","Type":"ContainerStarted","Data":"499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"}
Jul 29 01:39:33.087151 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:33.086680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" event={"ID":"74e2328e-96da-4c78-b79c-3dc74b62f9af","Type":"ContainerStarted","Data":"2cdb3f8e4c0bcacde1cec06b86c63155aecebdb83c55a6072d1118f0e6c08eb8"}
Jul 29 01:39:33.105405 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:33.105353    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podStartSLOduration=2.105312535 podStartE2EDuration="2.105312535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:39:33.104823289 +0000 UTC m=+1818.066820332" watchObservedRunningTime="2026-07-29 01:39:33.105312535 +0000 UTC m=+1818.067309541"
Jul 29 01:39:33.228928 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:33.228890    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:33.233730 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:33.233704    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:34.091605 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.091565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:34.092670 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.092650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:34.594378 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.594316    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"]
Jul 29 01:39:34.598162 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.598139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.600555 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.600529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9acc92f8-serving-cert\""
Jul 29 01:39:34.609700 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.609675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"]
Jul 29 01:39:34.707148 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.707110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpw5d\" (UniqueName: \"kubernetes.io/projected/0f079431-d005-4b60-a437-c746edc4ee13-kube-api-access-lpw5d\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.707370 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.707242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f079431-d005-4b60-a437-c746edc4ee13-openshift-service-ca\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.707370 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.707286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f079431-d005-4b60-a437-c746edc4ee13-maas-api-tls\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.808446 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.808408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f079431-d005-4b60-a437-c746edc4ee13-openshift-service-ca\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.808610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.808459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f079431-d005-4b60-a437-c746edc4ee13-maas-api-tls\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.808610 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.808517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpw5d\" (UniqueName: \"kubernetes.io/projected/0f079431-d005-4b60-a437-c746edc4ee13-kube-api-access-lpw5d\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.809067 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.809046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f079431-d005-4b60-a437-c746edc4ee13-openshift-service-ca\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.810894 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.810869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f079431-d005-4b60-a437-c746edc4ee13-maas-api-tls\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.816252 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.816231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpw5d\" (UniqueName: \"kubernetes.io/projected/0f079431-d005-4b60-a437-c746edc4ee13-kube-api-access-lpw5d\") pod \"maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:34.911515 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:34.911467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:35.271275 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:35.271246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"]
Jul 29 01:39:35.273407 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:39:35.273371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f079431_d005_4b60_a437_c746edc4ee13.slice/crio-ec011fe4b181ab139df7ca7ca5939e04f79521129327fddd695727cc6f1967c8 WatchSource:0}: Error finding container ec011fe4b181ab139df7ca7ca5939e04f79521129327fddd695727cc6f1967c8: Status 404 returned error can't find the container with id ec011fe4b181ab139df7ca7ca5939e04f79521129327fddd695727cc6f1967c8
Jul 29 01:39:35.275037 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:35.275014    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:39:36.104750 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:36.104665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr" event={"ID":"0f079431-d005-4b60-a437-c746edc4ee13","Type":"ContainerStarted","Data":"1269e0cc2ac0fe6a81b1faf94e2f7bb2a528675fab2a7784519123323d60051d"}
Jul 29 01:39:36.104750 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:36.104725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr" event={"ID":"0f079431-d005-4b60-a437-c746edc4ee13","Type":"ContainerStarted","Data":"ec011fe4b181ab139df7ca7ca5939e04f79521129327fddd695727cc6f1967c8"}
Jul 29 01:39:36.104951 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:36.104791    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:36.122997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:36.122949    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr" podStartSLOduration=1.60606069 podStartE2EDuration="2.122934541s" totalImagesPullingTime="516.873851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:39:36.121138204 +0000 UTC m=+1821.083135224" watchObservedRunningTime="2026-07-29 01:39:36.122934541 +0000 UTC m=+1821.084931548"
Jul 29 01:39:42.115593 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:42.115560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:39:47.169702 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:47.169670    2563 generic.go:356] "Generic (PLEG): container finished" podID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerID="499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db" exitCode=0
Jul 29 01:39:47.169702 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:47.169704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" event={"ID":"74e2328e-96da-4c78-b79c-3dc74b62f9af","Type":"ContainerDied","Data":"499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"}
Jul 29 01:39:47.170143 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:47.170036    2563 scope.go:117] "RemoveContainer" containerID="499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"
Jul 29 01:39:47.171115 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:47.171083    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:39:47.171180 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:47.171153    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:39:47.171244 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:47.171198    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:39:48.176855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:48.176819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" event={"ID":"74e2328e-96da-4c78-b79c-3dc74b62f9af","Type":"ContainerStarted","Data":"ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204"}
Jul 29 01:39:48.228425 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:48.228394    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:48.229329 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:48.229310    2563 patch_prober.go:28] interesting pod/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 29 01:39:48.229404 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:48.229360    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 29 01:39:49.091803 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:49.091751    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:49.229036 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:49.229004    2563 patch_prober.go:28] interesting pod/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 29 01:39:49.229452 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:49.229054    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 29 01:39:50.229257 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:50.229221    2563 patch_prober.go:28] interesting pod/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 29 01:39:50.229652 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:50.229273    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 29 01:39:51.228916 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:51.228878    2563 patch_prober.go:28] interesting pod/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 29 01:39:51.229091 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:51.228941    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 29 01:39:52.232642 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:52.232612    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:39:52.233598 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:39:52.233574    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:42:38.392154 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.392112    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"]
Jul 29 01:42:38.395855 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.395826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:38.398308 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.398275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:42:38.410267 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.410232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"]
Jul 29 01:42:38.495755 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.495712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da0032d-477e-458e-b0db-5c7dcd748fcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8\" (UID: \"2da0032d-477e-458e-b0db-5c7dcd748fcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:38.597491 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.597446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da0032d-477e-458e-b0db-5c7dcd748fcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8\" (UID: \"2da0032d-477e-458e-b0db-5c7dcd748fcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:38.598104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.598077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da0032d-477e-458e-b0db-5c7dcd748fcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8\" (UID: \"2da0032d-477e-458e-b0db-5c7dcd748fcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:38.707964 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.707864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:38.855101 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:38.855071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"]
Jul 29 01:42:38.857175 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:42:38.857127    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da0032d_477e_458e_b0db_5c7dcd748fcd.slice/crio-603f887a86516680b7e0703d352ef39743f7d15ad11eafcf0b8157a907d90eda WatchSource:0}: Error finding container 603f887a86516680b7e0703d352ef39743f7d15ad11eafcf0b8157a907d90eda: Status 404 returned error can't find the container with id 603f887a86516680b7e0703d352ef39743f7d15ad11eafcf0b8157a907d90eda
Jul 29 01:42:39.046978 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:39.046875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8" event={"ID":"2da0032d-477e-458e-b0db-5c7dcd748fcd","Type":"ContainerStarted","Data":"603f887a86516680b7e0703d352ef39743f7d15ad11eafcf0b8157a907d90eda"}
Jul 29 01:42:40.054165 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:40.054128    2563 generic.go:356] "Generic (PLEG): container finished" podID="2da0032d-477e-458e-b0db-5c7dcd748fcd" containerID="acde5f8cac168bda84f710cf792899ff5f9cbad7051a6718b7d51aad14b88c0d" exitCode=0
Jul 29 01:42:40.054627 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:40.054218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8" event={"ID":"2da0032d-477e-458e-b0db-5c7dcd748fcd","Type":"ContainerDied","Data":"acde5f8cac168bda84f710cf792899ff5f9cbad7051a6718b7d51aad14b88c0d"}
Jul 29 01:42:41.205576 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:41.205536    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:41.219490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:41.219447    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da0032d-477e-458e-b0db-5c7dcd748fcd-maas-api-service-ca\") pod \"2da0032d-477e-458e-b0db-5c7dcd748fcd\" (UID: \"2da0032d-477e-458e-b0db-5c7dcd748fcd\") "
Jul 29 01:42:41.219877 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:41.219846    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da0032d-477e-458e-b0db-5c7dcd748fcd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2da0032d-477e-458e-b0db-5c7dcd748fcd" (UID: "2da0032d-477e-458e-b0db-5c7dcd748fcd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:41.320315 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:41.320174    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da0032d-477e-458e-b0db-5c7dcd748fcd-maas-api-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:42.066248 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:42.066172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8" event={"ID":"2da0032d-477e-458e-b0db-5c7dcd748fcd","Type":"ContainerDied","Data":"603f887a86516680b7e0703d352ef39743f7d15ad11eafcf0b8157a907d90eda"}
Jul 29 01:42:42.066248 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:42.066237    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"
Jul 29 01:42:42.066484 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:42.066270    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="603f887a86516680b7e0703d352ef39743f7d15ad11eafcf0b8157a907d90eda"
Jul 29 01:42:48.844397 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:48.844270    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"]
Jul 29 01:42:48.844967 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:48.844554    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr" podUID="0f079431-d005-4b60-a437-c746edc4ee13" containerName="maas-api" containerID="cri-o://1269e0cc2ac0fe6a81b1faf94e2f7bb2a528675fab2a7784519123323d60051d" gracePeriod=30
Jul 29 01:42:49.098198 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.098142    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"]
Jul 29 01:42:49.102146 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.102110    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9acc92f8-vm5b8"]
Jul 29 01:42:49.110835 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.110788    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f079431-d005-4b60-a437-c746edc4ee13" containerID="1269e0cc2ac0fe6a81b1faf94e2f7bb2a528675fab2a7784519123323d60051d" exitCode=0
Jul 29 01:42:49.111040 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.110970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr" event={"ID":"0f079431-d005-4b60-a437-c746edc4ee13","Type":"ContainerDied","Data":"1269e0cc2ac0fe6a81b1faf94e2f7bb2a528675fab2a7784519123323d60051d"}
Jul 29 01:42:49.111040 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.111026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr" event={"ID":"0f079431-d005-4b60-a437-c746edc4ee13","Type":"ContainerDied","Data":"ec011fe4b181ab139df7ca7ca5939e04f79521129327fddd695727cc6f1967c8"}
Jul 29 01:42:49.111146 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.111051    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec011fe4b181ab139df7ca7ca5939e04f79521129327fddd695727cc6f1967c8"
Jul 29 01:42:49.129533 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.129497    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:42:49.192594 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.192548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpw5d\" (UniqueName: \"kubernetes.io/projected/0f079431-d005-4b60-a437-c746edc4ee13-kube-api-access-lpw5d\") pod \"0f079431-d005-4b60-a437-c746edc4ee13\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") "
Jul 29 01:42:49.192594 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.192596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f079431-d005-4b60-a437-c746edc4ee13-openshift-service-ca\") pod \"0f079431-d005-4b60-a437-c746edc4ee13\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") "
Jul 29 01:42:49.192811 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.192659    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f079431-d005-4b60-a437-c746edc4ee13-maas-api-tls\") pod \"0f079431-d005-4b60-a437-c746edc4ee13\" (UID: \"0f079431-d005-4b60-a437-c746edc4ee13\") "
Jul 29 01:42:49.193062 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.193022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f079431-d005-4b60-a437-c746edc4ee13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f079431-d005-4b60-a437-c746edc4ee13" (UID: "0f079431-d005-4b60-a437-c746edc4ee13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:49.195178 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.195140    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f079431-d005-4b60-a437-c746edc4ee13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f079431-d005-4b60-a437-c746edc4ee13" (UID: "0f079431-d005-4b60-a437-c746edc4ee13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:42:49.195358 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.195152    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f079431-d005-4b60-a437-c746edc4ee13-kube-api-access-lpw5d" (OuterVolumeSpecName: "kube-api-access-lpw5d") pod "0f079431-d005-4b60-a437-c746edc4ee13" (UID: "0f079431-d005-4b60-a437-c746edc4ee13"). InnerVolumeSpecName "kube-api-access-lpw5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:49.258829 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.258785    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"]
Jul 29 01:42:49.259079 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.259031    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy" containerID="cri-o://ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204" gracePeriod=30
Jul 29 01:42:49.294358 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.294301    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpw5d\" (UniqueName: \"kubernetes.io/projected/0f079431-d005-4b60-a437-c746edc4ee13-kube-api-access-lpw5d\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.294358 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.294344    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f079431-d005-4b60-a437-c746edc4ee13-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.294358 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.294354    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f079431-d005-4b60-a437-c746edc4ee13-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.546029 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:49.545987    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da0032d-477e-458e-b0db-5c7dcd748fcd" path="/var/lib/kubelet/pods/2da0032d-477e-458e-b0db-5c7dcd748fcd/volumes"
Jul 29 01:42:50.116750 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.116706    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"
Jul 29 01:42:50.155571 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.155520    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"]
Jul 29 01:42:50.165621 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.165562    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9acc92f8-bb7b7db85-dqhgr"]
Jul 29 01:42:50.451311 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451273    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"]
Jul 29 01:42:50.451684 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451669    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f079431-d005-4b60-a437-c746edc4ee13" containerName="maas-api"
Jul 29 01:42:50.451733 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451685    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f079431-d005-4b60-a437-c746edc4ee13" containerName="maas-api"
Jul 29 01:42:50.451733 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451701    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da0032d-477e-458e-b0db-5c7dcd748fcd" containerName="revoke-keys"
Jul 29 01:42:50.451733 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451707    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da0032d-477e-458e-b0db-5c7dcd748fcd" containerName="revoke-keys"
Jul 29 01:42:50.451831 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451783    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f079431-d005-4b60-a437-c746edc4ee13" containerName="maas-api"
Jul 29 01:42:50.451831 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.451791    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da0032d-477e-458e-b0db-5c7dcd748fcd" containerName="revoke-keys"
Jul 29 01:42:50.455394 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.455362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.458673 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.458640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3a585460-gw-openshift-default-dockercfg-kx6kj\""
Jul 29 01:42:50.471957 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.471917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"]
Jul 29 01:42:50.505762 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.505716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a55849e-f911-46ae-801b-17d00196a28a-istiod-ca-cert\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.505762 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.505765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-credential-socket\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.505985 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.505793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9tmr\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-kube-api-access-d9tmr\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.505985 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.505886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a55849e-f911-46ae-801b-17d00196a28a-istio-podinfo\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.505985 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.505949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-certs\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.506087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.505988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-istio-token\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.506087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.506015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-envoy\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.506087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.506054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-data\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.506204 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.506092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-socket\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607045 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-certs\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607045 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-istio-token\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-envoy\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-data\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607379 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-socket\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a55849e-f911-46ae-801b-17d00196a28a-istiod-ca-cert\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-credential-socket\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607677 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-certs\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607748 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-socket\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607748 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9tmr\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-kube-api-access-d9tmr\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607748 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-credential-socket\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.607894 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.607772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a55849e-f911-46ae-801b-17d00196a28a-istio-podinfo\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.608080 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.608060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-data\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.608210 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.608163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a55849e-f911-46ae-801b-17d00196a28a-istiod-ca-cert\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.610237 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.610160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-envoy\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.610386 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.610273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a55849e-f911-46ae-801b-17d00196a28a-istio-podinfo\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.616938 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.616899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-istio-token\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.617129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.617065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9tmr\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-kube-api-access-d9tmr\") pod \"e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") " pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.767889 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.767761    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:50.931922 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.931891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"]
Jul 29 01:42:50.935046 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:42:50.935007    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a55849e_f911_46ae_801b_17d00196a28a.slice/crio-411480adf6e2500d53d8fa74d2a59d086f93122115879a0d2431ce3ed837d576 WatchSource:0}: Error finding container 411480adf6e2500d53d8fa74d2a59d086f93122115879a0d2431ce3ed837d576: Status 404 returned error can't find the container with id 411480adf6e2500d53d8fa74d2a59d086f93122115879a0d2431ce3ed837d576
Jul 29 01:42:50.937581 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.937534    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:42:50.937701 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.937620    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:42:50.937701 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:50.937653    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:42:51.125477 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:51.125427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" event={"ID":"5a55849e-f911-46ae-801b-17d00196a28a","Type":"ContainerStarted","Data":"fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"}
Jul 29 01:42:51.126020 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:51.125503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" event={"ID":"5a55849e-f911-46ae-801b-17d00196a28a","Type":"ContainerStarted","Data":"411480adf6e2500d53d8fa74d2a59d086f93122115879a0d2431ce3ed837d576"}
Jul 29 01:42:51.148568 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:51.148482    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" podStartSLOduration=1.148457184 podStartE2EDuration="1.148457184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:51.144844753 +0000 UTC m=+2016.106841760" watchObservedRunningTime="2026-07-29 01:42:51.148457184 +0000 UTC m=+2016.110454196"
Jul 29 01:42:51.548383 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:51.548272    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f079431-d005-4b60-a437-c746edc4ee13" path="/var/lib/kubelet/pods/0f079431-d005-4b60-a437-c746edc4ee13/volumes"
Jul 29 01:42:51.768646 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:51.768592    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:52.235750 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:52.235709    2563 patch_prober.go:28] interesting pod/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:42:52.236238 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:52.235774    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:42:52.774543 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:52.774504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:53.137543 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:53.137507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:53.138916 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:53.138884    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:42:54.532999 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.532908    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:42:54.647474 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-podinfo\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-data\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647534    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-token\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z5jm\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-kube-api-access-8z5jm\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647582    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-certs\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-envoy\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647958 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-socket\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647958 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74e2328e-96da-4c78-b79c-3dc74b62f9af-istiod-ca-cert\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647958 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-credential-socket\") pod \"74e2328e-96da-4c78-b79c-3dc74b62f9af\" (UID: \"74e2328e-96da-4c78-b79c-3dc74b62f9af\") "
Jul 29 01:42:54.647958 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.647875    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:54.648254 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.648062    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:54.648254 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.648163    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.648254 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.648220    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.648429 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.648328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:54.648467 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.648433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e2328e-96da-4c78-b79c-3dc74b62f9af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:54.648582 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.648550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-data" (OuterVolumeSpecName: "istio-data") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:54.650117 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.650077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-token" (OuterVolumeSpecName: "istio-token") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:54.650117 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.650094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:42:54.650348 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.650077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-kube-api-access-8z5jm" (OuterVolumeSpecName: "kube-api-access-8z5jm") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "kube-api-access-8z5jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:54.650348 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.650218    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74e2328e-96da-4c78-b79c-3dc74b62f9af" (UID: "74e2328e-96da-4c78-b79c-3dc74b62f9af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:54.749314 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749265    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74e2328e-96da-4c78-b79c-3dc74b62f9af-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.749314 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749301    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.749314 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749312    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.749314 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749323    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.749314 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749330    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.749624 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749339    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z5jm\" (UniqueName: \"kubernetes.io/projected/74e2328e-96da-4c78-b79c-3dc74b62f9af-kube-api-access-8z5jm\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:54.749624 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:54.749347    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74e2328e-96da-4c78-b79c-3dc74b62f9af-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:42:55.152064 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.152023    2563 generic.go:356] "Generic (PLEG): container finished" podID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerID="ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204" exitCode=0
Jul 29 01:42:55.152299 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.152084    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"
Jul 29 01:42:55.152299 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.152111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" event={"ID":"74e2328e-96da-4c78-b79c-3dc74b62f9af","Type":"ContainerDied","Data":"ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204"}
Jul 29 01:42:55.152299 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.152174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4" event={"ID":"74e2328e-96da-4c78-b79c-3dc74b62f9af","Type":"ContainerDied","Data":"2cdb3f8e4c0bcacde1cec06b86c63155aecebdb83c55a6072d1118f0e6c08eb8"}
Jul 29 01:42:55.152299 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.152238    2563 scope.go:117] "RemoveContainer" containerID="ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204"
Jul 29 01:42:55.162458 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.162435    2563 scope.go:117] "RemoveContainer" containerID="499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"
Jul 29 01:42:55.172042 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.171959    2563 scope.go:117] "RemoveContainer" containerID="ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204"
Jul 29 01:42:55.173084 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:42:55.172809    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204\": container with ID starting with ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204 not found: ID does not exist" containerID="ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204"
Jul 29 01:42:55.173084 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.172859    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204"} err="failed to get container status \"ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204\": rpc error: code = NotFound desc = could not find container \"ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204\": container with ID starting with ca6b706d3e1ee8fb3c06e05a748ec67bc4fe6c79173e0a9651597e13de339204 not found: ID does not exist"
Jul 29 01:42:55.173084 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.172889    2563 scope.go:117] "RemoveContainer" containerID="499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"
Jul 29 01:42:55.173444 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:42:55.173366    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db\": container with ID starting with 499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db not found: ID does not exist" containerID="499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"
Jul 29 01:42:55.173511 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.173434    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db"} err="failed to get container status \"499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db\": rpc error: code = NotFound desc = could not find container \"499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db\": container with ID starting with 499518d760916f865a344f2c6f0769b3db1ec5a6df7620b26abd576e9978f3db not found: ID does not exist"
Jul 29 01:42:55.175547 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.175499    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"]
Jul 29 01:42:55.177576 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.177544    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9acc92f8-openshift-default-67678ff4f4-c2ck4"]
Jul 29 01:42:55.546397 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:42:55.546270    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" path="/var/lib/kubelet/pods/74e2328e-96da-4c78-b79c-3dc74b62f9af/volumes"
Jul 29 01:43:07.222579 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:07.222490    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a55849e-f911-46ae-801b-17d00196a28a" containerID="fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5" exitCode=0
Jul 29 01:43:07.222579 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:07.222561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" event={"ID":"5a55849e-f911-46ae-801b-17d00196a28a","Type":"ContainerDied","Data":"fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"}
Jul 29 01:43:07.223038 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:07.222999    2563 scope.go:117] "RemoveContainer" containerID="fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"
Jul 29 01:43:07.224163 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:07.224128    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:43:07.224270 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:07.224242    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:43:07.224311 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:07.224277    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:43:08.137698 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:08.137645    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:43:08.230495 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:08.230457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" event={"ID":"5a55849e-f911-46ae-801b-17d00196a28a","Type":"ContainerStarted","Data":"297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f"}
Jul 29 01:43:08.769039 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:08.768986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:43:08.770106 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:08.770078    2563 patch_prober.go:28] interesting pod/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:43:08.770256 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:08.770135    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 01:43:09.768490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:09.768448    2563 patch_prober.go:28] interesting pod/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:43:09.768887 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:09.768509    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 01:43:10.768447 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:10.768403    2563 patch_prober.go:28] interesting pod/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:43:10.768651 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:10.768467    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 01:43:11.769224 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:11.769159    2563 patch_prober.go:28] interesting pod/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:43:11.769648 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:11.769234    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 29 01:43:12.772775 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:12.772738    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:43:12.773219 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:12.773026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:43:12.774087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:43:12.774061    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:44:15.743854 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:44:15.743823    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:44:15.752292 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:44:15.752264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:45:00.140220 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140161    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"]
Jul 29 01:45:00.140816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140584    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy"
Jul 29 01:45:00.140816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140597    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy"
Jul 29 01:45:00.140816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140615    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy"
Jul 29 01:45:00.140816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140621    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy"
Jul 29 01:45:00.140816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140690    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy"
Jul 29 01:45:00.140816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.140700    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e2328e-96da-4c78-b79c-3dc74b62f9af" containerName="istio-proxy"
Jul 29 01:45:00.143938 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.143902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"
Jul 29 01:45:00.147178 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.147148    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:45:00.154552 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.154527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"
Jul 29 01:45:00.167620 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.167587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"]
Jul 29 01:45:00.309967 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.309939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"]
Jul 29 01:45:00.313022 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:45:00.312982    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7110a796_0d3b_4274_b54c_b1d9b0761fe6.slice/crio-da1f21a2140a7b4325f0cca40fce3bb5cdde5036b1896217821c93da3fb66435 WatchSource:0}: Error finding container da1f21a2140a7b4325f0cca40fce3bb5cdde5036b1896217821c93da3fb66435: Status 404 returned error can't find the container with id da1f21a2140a7b4325f0cca40fce3bb5cdde5036b1896217821c93da3fb66435
Jul 29 01:45:00.859426 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.859311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs" event={"ID":"7110a796-0d3b-4274-b54c-b1d9b0761fe6","Type":"ContainerStarted","Data":"7041309b7493333394b2cd2f514e310f469378657529be0a6c5a4b342a851e31"}
Jul 29 01:45:00.859426 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.859371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs" event={"ID":"7110a796-0d3b-4274-b54c-b1d9b0761fe6","Type":"ContainerStarted","Data":"da1f21a2140a7b4325f0cca40fce3bb5cdde5036b1896217821c93da3fb66435"}
Jul 29 01:45:00.876202 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:00.876127    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs" podStartSLOduration=0.876107632 podStartE2EDuration="876.107632ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:00.875325351 +0000 UTC m=+2145.837322382" watchObservedRunningTime="2026-07-29 01:45:00.876107632 +0000 UTC m=+2145.838104640"
Jul 29 01:45:01.866176 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:01.866139    2563 generic.go:356] "Generic (PLEG): container finished" podID="7110a796-0d3b-4274-b54c-b1d9b0761fe6" containerID="7041309b7493333394b2cd2f514e310f469378657529be0a6c5a4b342a851e31" exitCode=0
Jul 29 01:45:01.866632 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:01.866225    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs" event={"ID":"7110a796-0d3b-4274-b54c-b1d9b0761fe6","Type":"ContainerDied","Data":"7041309b7493333394b2cd2f514e310f469378657529be0a6c5a4b342a851e31"}
Jul 29 01:45:03.011894 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:03.011853    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"
Jul 29 01:45:03.879762 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:03.879733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"
Jul 29 01:45:03.879957 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:03.879760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs" event={"ID":"7110a796-0d3b-4274-b54c-b1d9b0761fe6","Type":"ContainerDied","Data":"da1f21a2140a7b4325f0cca40fce3bb5cdde5036b1896217821c93da3fb66435"}
Jul 29 01:45:03.879957 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:45:03.879811    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da1f21a2140a7b4325f0cca40fce3bb5cdde5036b1896217821c93da3fb66435"
Jul 29 01:46:15.752914 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:46:15.752870    2563 scope.go:117] "RemoveContainer" containerID="1269e0cc2ac0fe6a81b1faf94e2f7bb2a528675fab2a7784519123323d60051d"
Jul 29 01:47:01.401548 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:01.401454    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"]
Jul 29 01:47:01.404826 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:01.404778    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-3a585460-29754825-9f4zs"]
Jul 29 01:47:01.545909 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:01.545869    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7110a796-0d3b-4274-b54c-b1d9b0761fe6" path="/var/lib/kubelet/pods/7110a796-0d3b-4274-b54c-b1d9b0761fe6/volumes"
Jul 29 01:47:01.757844 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:01.757747    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"]
Jul 29 01:47:01.758026 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:01.757993    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy" containerID="cri-o://297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f" gracePeriod=30
Jul 29 01:47:02.599292 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.599243    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"]
Jul 29 01:47:02.599809 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.599790    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7110a796-0d3b-4274-b54c-b1d9b0761fe6" containerName="cleanup"
Jul 29 01:47:02.599809 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.599810    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7110a796-0d3b-4274-b54c-b1d9b0761fe6" containerName="cleanup"
Jul 29 01:47:02.599906 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.599897    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7110a796-0d3b-4274-b54c-b1d9b0761fe6" containerName="cleanup"
Jul 29 01:47:02.603262 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.603236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.605858 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.605825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-000a4d6e-openshift-default-dockercfg-4lqts\""
Jul 29 01:47:02.621838 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.621799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"]
Jul 29 01:47:02.639951 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.639894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-data\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640173 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.639962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-certs\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640173 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-socket\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640173 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-podinfo\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640173 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97fbdce-42e4-4285-9f5d-482c15de2d92-istiod-ca-cert\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-token\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5skm\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-kube-api-access-k5skm\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-credential-socket\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.640466 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.640322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-envoy\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-socket\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741686 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-podinfo\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741974 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97fbdce-42e4-4285-9f5d-482c15de2d92-istiod-ca-cert\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741974 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-token\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741974 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5skm\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-kube-api-access-k5skm\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741974 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-credential-socket\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.741974 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.741970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-envoy\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742261 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-data\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742261 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-certs\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742261 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-socket\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742420 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-credential-socket\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742484 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-certs\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742539 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-data\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.742942 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.742911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97fbdce-42e4-4285-9f5d-482c15de2d92-istiod-ca-cert\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.744547 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.744523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-envoy\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.744663 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.744628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-podinfo\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.754746 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.754706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-token\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.755056 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.755031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5skm\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-kube-api-access-k5skm\") pod \"e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") " pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:02.915464 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:02.915418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:03.077698 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.077616    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"]
Jul 29 01:47:03.080366 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:47:03.080325    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97fbdce_42e4_4285_9f5d_482c15de2d92.slice/crio-cdae93ec768e0a7bea55bccee8f21ea014020f6211d74a097b1fe8594473af2e WatchSource:0}: Error finding container cdae93ec768e0a7bea55bccee8f21ea014020f6211d74a097b1fe8594473af2e: Status 404 returned error can't find the container with id cdae93ec768e0a7bea55bccee8f21ea014020f6211d74a097b1fe8594473af2e
Jul 29 01:47:03.082826 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.082788    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:47:03.082938 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.082863    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:47:03.082938 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.082893    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:47:03.535519 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.535468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" event={"ID":"a97fbdce-42e4-4285-9f5d-482c15de2d92","Type":"ContainerStarted","Data":"3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"}
Jul 29 01:47:03.535696 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.535543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" event={"ID":"a97fbdce-42e4-4285-9f5d-482c15de2d92","Type":"ContainerStarted","Data":"cdae93ec768e0a7bea55bccee8f21ea014020f6211d74a097b1fe8594473af2e"}
Jul 29 01:47:03.584380 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.584321    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podStartSLOduration=1.584298259 podStartE2EDuration="1.584298259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:03.582497514 +0000 UTC m=+2268.544494523" watchObservedRunningTime="2026-07-29 01:47:03.584298259 +0000 UTC m=+2268.546295267"
Jul 29 01:47:03.916419 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:03.916372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:04.921646 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:04.921611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:05.546410 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:05.546377    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:05.547590 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:05.547561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:07.024572 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.024479    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:47:07.088650 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-data\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.088837 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088665    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a55849e-f911-46ae-801b-17d00196a28a-istiod-ca-cert\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.088837 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-istio-token\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.088837 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088725    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9tmr\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-kube-api-access-d9tmr\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.088837 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088786    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-certs\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.089008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088882    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a55849e-f911-46ae-801b-17d00196a28a-istio-podinfo\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.089008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088928    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-socket\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.089008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.088964    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-credential-socket\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.089365 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089223    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:07.089365 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089248    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:07.089365 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:07.089365 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-envoy\") pod \"5a55849e-f911-46ae-801b-17d00196a28a\" (UID: \"5a55849e-f911-46ae-801b-17d00196a28a\") "
Jul 29 01:47:07.089661 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089621    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.089661 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089639    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.089661 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089645    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a55849e-f911-46ae-801b-17d00196a28a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:07.089821 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089655    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.089821 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.089727    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:07.091319 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.091283    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:07.091449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.091429    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:07.091527 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.091500    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a55849e-f911-46ae-801b-17d00196a28a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:47:07.091567 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.091515    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-kube-api-access-d9tmr" (OuterVolumeSpecName: "kube-api-access-d9tmr") pod "5a55849e-f911-46ae-801b-17d00196a28a" (UID: "5a55849e-f911-46ae-801b-17d00196a28a"). InnerVolumeSpecName "kube-api-access-d9tmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:07.190772 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.190722    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a55849e-f911-46ae-801b-17d00196a28a-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.190772 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.190762    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.190772 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.190773    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a55849e-f911-46ae-801b-17d00196a28a-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.190772 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.190787    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a55849e-f911-46ae-801b-17d00196a28a-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.191062 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.190797    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.191062 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.190809    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9tmr\" (UniqueName: \"kubernetes.io/projected/5a55849e-f911-46ae-801b-17d00196a28a-kube-api-access-d9tmr\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:47:07.560292 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.560253    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a55849e-f911-46ae-801b-17d00196a28a" containerID="297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f" exitCode=0
Jul 29 01:47:07.560490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.560304    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"
Jul 29 01:47:07.560490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.560342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" event={"ID":"5a55849e-f911-46ae-801b-17d00196a28a","Type":"ContainerDied","Data":"297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f"}
Jul 29 01:47:07.560490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.560404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd" event={"ID":"5a55849e-f911-46ae-801b-17d00196a28a","Type":"ContainerDied","Data":"411480adf6e2500d53d8fa74d2a59d086f93122115879a0d2431ce3ed837d576"}
Jul 29 01:47:07.560490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.560433    2563 scope.go:117] "RemoveContainer" containerID="297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f"
Jul 29 01:47:07.570603 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.570579    2563 scope.go:117] "RemoveContainer" containerID="fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"
Jul 29 01:47:07.578008 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.577970    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"]
Jul 29 01:47:07.581166 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.581140    2563 scope.go:117] "RemoveContainer" containerID="297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f"
Jul 29 01:47:07.581566 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:47:07.581541    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f\": container with ID starting with 297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f not found: ID does not exist" containerID="297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f"
Jul 29 01:47:07.581647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.581575    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f"} err="failed to get container status \"297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f\": rpc error: code = NotFound desc = could not find container \"297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f\": container with ID starting with 297a8b639b38154d1057cfdef8ea245dd7208debda333c7f5a3d8fc4bb77a85f not found: ID does not exist"
Jul 29 01:47:07.581647 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.581594    2563 scope.go:117] "RemoveContainer" containerID="fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"
Jul 29 01:47:07.581891 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:47:07.581872    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5\": container with ID starting with fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5 not found: ID does not exist" containerID="fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"
Jul 29 01:47:07.581941 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.581895    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5"} err="failed to get container status \"fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5\": rpc error: code = NotFound desc = could not find container \"fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5\": container with ID starting with fadfbb0df065d54dd6aa1c9054e72773674d2a83f0971f8cab79a8c62b3890c5 not found: ID does not exist"
Jul 29 01:47:07.582245 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:07.582220    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3a585460-gw-openshift-default-6c945b7dfb-khjkd"]
Jul 29 01:47:09.549557 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:09.549508    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a55849e-f911-46ae-801b-17d00196a28a" path="/var/lib/kubelet/pods/5a55849e-f911-46ae-801b-17d00196a28a/volumes"
Jul 29 01:47:17.619965 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:17.619919    2563 generic.go:356] "Generic (PLEG): container finished" podID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerID="3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2" exitCode=0
Jul 29 01:47:17.620431 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:17.619993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" event={"ID":"a97fbdce-42e4-4285-9f5d-482c15de2d92","Type":"ContainerDied","Data":"3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"}
Jul 29 01:47:17.620487 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:17.620461    2563 scope.go:117] "RemoveContainer" containerID="3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"
Jul 29 01:47:17.621742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:17.621705    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:47:17.621804 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:17.621787    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:47:17.621840 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:17.621819    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:47:18.628033 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:18.627998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" event={"ID":"a97fbdce-42e4-4285-9f5d-482c15de2d92","Type":"ContainerStarted","Data":"e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e"}
Jul 29 01:47:18.916670 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:18.916576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:18.917904 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:18.917877    2563 patch_prober.go:28] interesting pod/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:47:18.917973 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:18.917934    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 01:47:19.916043 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:19.915999    2563 patch_prober.go:28] interesting pod/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:47:19.916502 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:19.916081    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 01:47:20.546540 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:20.546495    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:20.916355 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:20.916305    2563 patch_prober.go:28] interesting pod/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:47:20.916800 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:20.916376    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 01:47:21.916021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:21.915963    2563 patch_prober.go:28] interesting pod/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:47:21.916279 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:21.916028    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 01:47:22.921127 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:22.921093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:47:22.922207 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:47:22.922157    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:49:15.776734 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:49:15.776698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:49:15.787471 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:49:15.787442    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:49:15.800572 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:49:15.800538    2563 scope.go:117] "RemoveContainer" containerID="acde5f8cac168bda84f710cf792899ff5f9cbad7051a6718b7d51aad14b88c0d"
Jul 29 01:50:19.681602 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:19.681561    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"]
Jul 29 01:50:19.682146 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:19.681872    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy" containerID="cri-o://e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e" gracePeriod=30
Jul 29 01:50:20.568927 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.568883    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"]
Jul 29 01:50:20.569529 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.569508    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy"
Jul 29 01:50:20.569529 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.569530    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy"
Jul 29 01:50:20.569725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.569550    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy"
Jul 29 01:50:20.569725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.569559    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy"
Jul 29 01:50:20.569725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.569643    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy"
Jul 29 01:50:20.569725 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.569658    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a55849e-f911-46ae-801b-17d00196a28a" containerName="istio-proxy"
Jul 29 01:50:20.573233 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.573206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.577093 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.577063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-74571164-openshift-default-dockercfg-xm8zw\""
Jul 29 01:50:20.589275 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.589239    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"]
Jul 29 01:50:20.666455 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-token\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.666657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g22wl\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-kube-api-access-g22wl\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.666657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-data\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.666657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-socket\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.666657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-envoy\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.666657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3accfd04-ea30-4302-8d8d-416dd6de04e5-istiod-ca-cert\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.666657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-certs\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.667006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-credential-socket\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.667006 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.666779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-podinfo\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767479 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-podinfo\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-token\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g22wl\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-kube-api-access-g22wl\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-data\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-socket\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-envoy\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3accfd04-ea30-4302-8d8d-416dd6de04e5-istiod-ca-cert\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-certs\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.767969 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.767850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-credential-socket\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.768438 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.768403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-socket\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.768438 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.768422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-certs\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.768556 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.768517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-data\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.768556 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.768514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-credential-socket\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.768826 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.768800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3accfd04-ea30-4302-8d8d-416dd6de04e5-istiod-ca-cert\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.770507 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.770478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-envoy\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.770657 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.770633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-podinfo\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.776816 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.776782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-token\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.777105 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.777082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g22wl\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-kube-api-access-g22wl\") pod \"e2e-derive-74571164-openshift-default-65858f45cb-g7qxc\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") " pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:20.884587 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:20.884543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:21.043987 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.043955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"]
Jul 29 01:50:21.046502 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:50:21.046469    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3accfd04_ea30_4302_8d8d_416dd6de04e5.slice/crio-731daf6cf9276a15a178e39e0b76c752c1f310b5d3f808ac2ecfa637b62535e4 WatchSource:0}: Error finding container 731daf6cf9276a15a178e39e0b76c752c1f310b5d3f808ac2ecfa637b62535e4: Status 404 returned error can't find the container with id 731daf6cf9276a15a178e39e0b76c752c1f310b5d3f808ac2ecfa637b62535e4
Jul 29 01:50:21.048923 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.048886    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:50:21.049019 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.048965    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:50:21.049019 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.049001    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:50:21.634578 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.634539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" event={"ID":"3accfd04-ea30-4302-8d8d-416dd6de04e5","Type":"ContainerStarted","Data":"8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"}
Jul 29 01:50:21.634760 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.634598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" event={"ID":"3accfd04-ea30-4302-8d8d-416dd6de04e5","Type":"ContainerStarted","Data":"731daf6cf9276a15a178e39e0b76c752c1f310b5d3f808ac2ecfa637b62535e4"}
Jul 29 01:50:21.655416 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.655358    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" podStartSLOduration=1.655342091 podStartE2EDuration="1.655342091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:50:21.653740392 +0000 UTC m=+2466.615737399" watchObservedRunningTime="2026-07-29 01:50:21.655342091 +0000 UTC m=+2466.617339098"
Jul 29 01:50:21.884926 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:21.884828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:22.890315 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:22.890272    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:22.923884 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:22.923841    2563 patch_prober.go:28] interesting pod/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:50:22.924057 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:22.923918    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:50:23.645336 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:23.645295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:23.646513 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:23.646491    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:24.944734 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:24.944647    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:50:25.010615 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.010574    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5skm\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-kube-api-access-k5skm\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.010615 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.010623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97fbdce-42e4-4285-9f5d-482c15de2d92-istiod-ca-cert\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.010848 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.010650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-envoy\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.010848 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.010681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-podinfo\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.010934 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.010862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-certs\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.011023 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.010996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-data\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.011087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011034    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-socket\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.011087 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-token\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.011226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-credential-socket\") pod \"a97fbdce-42e4-4285-9f5d-482c15de2d92\" (UID: \"a97fbdce-42e4-4285-9f5d-482c15de2d92\") "
Jul 29 01:50:25.011226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011123    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a97fbdce-42e4-4285-9f5d-482c15de2d92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:50:25.011226 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011133    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:25.011403 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011388    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:25.011586 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011561    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97fbdce-42e4-4285-9f5d-482c15de2d92-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.011700 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011589    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.011700 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011596    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:25.011700 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011603    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.011921 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.011899    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-data" (OuterVolumeSpecName: "istio-data") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:25.013171 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.013145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:50:25.013317 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.013290    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-token" (OuterVolumeSpecName: "istio-token") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:25.013408 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.013390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-kube-api-access-k5skm" (OuterVolumeSpecName: "kube-api-access-k5skm") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "kube-api-access-k5skm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:25.013448 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.013402    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a97fbdce-42e4-4285-9f5d-482c15de2d92" (UID: "a97fbdce-42e4-4285-9f5d-482c15de2d92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:25.112452 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.112400    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.112452 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.112436    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.112452 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.112453    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.112452 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.112463    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5skm\" (UniqueName: \"kubernetes.io/projected/a97fbdce-42e4-4285-9f5d-482c15de2d92-kube-api-access-k5skm\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.112738 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.112472    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.112738 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.112480    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97fbdce-42e4-4285-9f5d-482c15de2d92-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:50:25.663145 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.663104    2563 generic.go:356] "Generic (PLEG): container finished" podID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerID="e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e" exitCode=0
Jul 29 01:50:25.663344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.663168    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"
Jul 29 01:50:25.663344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.663178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" event={"ID":"a97fbdce-42e4-4285-9f5d-482c15de2d92","Type":"ContainerDied","Data":"e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e"}
Jul 29 01:50:25.663344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.663284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz" event={"ID":"a97fbdce-42e4-4285-9f5d-482c15de2d92","Type":"ContainerDied","Data":"cdae93ec768e0a7bea55bccee8f21ea014020f6211d74a097b1fe8594473af2e"}
Jul 29 01:50:25.663344 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.663327    2563 scope.go:117] "RemoveContainer" containerID="e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e"
Jul 29 01:50:25.675268 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.675241    2563 scope.go:117] "RemoveContainer" containerID="3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"
Jul 29 01:50:25.682559 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.682520    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"]
Jul 29 01:50:25.685920 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.685883    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-000a4d6e-openshift-default-85ff7c79f6-s98tz"]
Jul 29 01:50:25.686559 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.686543    2563 scope.go:117] "RemoveContainer" containerID="e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e"
Jul 29 01:50:25.686910 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:50:25.686888    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e\": container with ID starting with e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e not found: ID does not exist" containerID="e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e"
Jul 29 01:50:25.686959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.686923    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e"} err="failed to get container status \"e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e\": rpc error: code = NotFound desc = could not find container \"e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e\": container with ID starting with e09d6d0aaf21a3a4308e8a98661d0cbaef4bd8a87359205b5eb4130076ab9b0e not found: ID does not exist"
Jul 29 01:50:25.686959 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.686954    2563 scope.go:117] "RemoveContainer" containerID="3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"
Jul 29 01:50:25.687354 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:50:25.687330    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2\": container with ID starting with 3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2 not found: ID does not exist" containerID="3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"
Jul 29 01:50:25.687432 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:25.687362    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2"} err="failed to get container status \"3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2\": rpc error: code = NotFound desc = could not find container \"3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2\": container with ID starting with 3fa32832d0fd9445e6ebfeb62b67c210e8ec20a5a89e3a5e1e6fee17a910a5e2 not found: ID does not exist"
Jul 29 01:50:27.545752 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:27.545712    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" path="/var/lib/kubelet/pods/a97fbdce-42e4-4285-9f5d-482c15de2d92/volumes"
Jul 29 01:50:37.730114 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:37.730079    2563 generic.go:356] "Generic (PLEG): container finished" podID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerID="8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98" exitCode=0
Jul 29 01:50:37.730579 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:37.730153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" event={"ID":"3accfd04-ea30-4302-8d8d-416dd6de04e5","Type":"ContainerDied","Data":"8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"}
Jul 29 01:50:37.730636 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:37.730621    2563 scope.go:117] "RemoveContainer" containerID="8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"
Jul 29 01:50:37.731753 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:37.731719    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:50:37.731833 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:37.731815    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:50:37.731871 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:37.731856    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:50:38.645427 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:38.645382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:38.758245 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:38.758049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" event={"ID":"3accfd04-ea30-4302-8d8d-416dd6de04e5","Type":"ContainerStarted","Data":"8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507"}
Jul 29 01:50:38.885548 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:38.885499    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:38.886813 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:38.886779    2563 patch_prober.go:28] interesting pod/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 01:50:38.886945 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:38.886840    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 01:50:39.885590 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:39.885542    2563 patch_prober.go:28] interesting pod/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 01:50:39.886021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:39.885614    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 01:50:40.885652 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:40.885602    2563 patch_prober.go:28] interesting pod/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 01:50:40.886081 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:40.885669    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 01:50:41.884985 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:41.884943    2563 patch_prober.go:28] interesting pod/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 01:50:41.885224 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:41.885006    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 01:50:42.889531 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:42.889488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:42.890021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:42.889789    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:50:42.890771 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:50:42.890750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:51:15.829803 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:51:15.829751    2563 scope.go:117] "RemoveContainer" containerID="7041309b7493333394b2cd2f514e310f469378657529be0a6c5a4b342a851e31"
Jul 29 01:52:36.080884 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:36.080845    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"]
Jul 29 01:52:36.081489 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:36.081137    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy" containerID="cri-o://8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507" gracePeriod=30
Jul 29 01:52:41.354213 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.354123    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:52:41.410104 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.410062    2563 generic.go:356] "Generic (PLEG): container finished" podID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerID="8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507" exitCode=0
Jul 29 01:52:41.410304 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.410116    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"
Jul 29 01:52:41.410304 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.410145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" event={"ID":"3accfd04-ea30-4302-8d8d-416dd6de04e5","Type":"ContainerDied","Data":"8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507"}
Jul 29 01:52:41.410304 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.410234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc" event={"ID":"3accfd04-ea30-4302-8d8d-416dd6de04e5","Type":"ContainerDied","Data":"731daf6cf9276a15a178e39e0b76c752c1f310b5d3f808ac2ecfa637b62535e4"}
Jul 29 01:52:41.410304 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.410263    2563 scope.go:117] "RemoveContainer" containerID="8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507"
Jul 29 01:52:41.419643 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.419617    2563 scope.go:117] "RemoveContainer" containerID="8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"
Jul 29 01:52:41.431018 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.430990    2563 scope.go:117] "RemoveContainer" containerID="8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507"
Jul 29 01:52:41.431129 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g22wl\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-kube-api-access-g22wl\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431204 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-podinfo\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431264 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-credential-socket\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431264 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431246    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3accfd04-ea30-4302-8d8d-416dd6de04e5-istiod-ca-cert\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431374 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431275    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-envoy\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431374 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431303    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-certs\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431451 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-socket\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431451 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-data\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431545 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431478    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-token\") pod \"3accfd04-ea30-4302-8d8d-416dd6de04e5\" (UID: \"3accfd04-ea30-4302-8d8d-416dd6de04e5\") "
Jul 29 01:52:41.431620 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431590    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:52:41.431679 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431641    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:52:41.431872 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:52:41.432057 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.431894    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.432330 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.432158    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.432330 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.432108    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3accfd04-ea30-4302-8d8d-416dd6de04e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:41.432330 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:52:41.431927    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507\": container with ID starting with 8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507 not found: ID does not exist" containerID="8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507"
Jul 29 01:52:41.432330 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.432228    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507"} err="failed to get container status \"8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507\": rpc error: code = NotFound desc = could not find container \"8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507\": container with ID starting with 8da08017f1bc58f3a7eb01163b8c42b26d6a1a460d9b308538a12d2e45097507 not found: ID does not exist"
Jul 29 01:52:41.432330 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.432256    2563 scope.go:117] "RemoveContainer" containerID="8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"
Jul 29 01:52:41.432692 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:52:41.432639    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98\": container with ID starting with 8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98 not found: ID does not exist" containerID="8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"
Jul 29 01:52:41.432692 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.432663    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:52:41.432692 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.432668    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98"} err="failed to get container status \"8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98\": rpc error: code = NotFound desc = could not find container \"8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98\": container with ID starting with 8b49171e48da37576557d88dba1408eb97c5a439a0a7c1d5f728043166379a98 not found: ID does not exist"
Jul 29 01:52:41.433772 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.433743    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:52:41.433887 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.433867    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-kube-api-access-g22wl" (OuterVolumeSpecName: "kube-api-access-g22wl") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "kube-api-access-g22wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:41.434012 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.433995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:41.434066 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.434037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3accfd04-ea30-4302-8d8d-416dd6de04e5" (UID: "3accfd04-ea30-4302-8d8d-416dd6de04e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:52:41.532716 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532669    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.532716 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532707    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.532716 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532717    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.532716 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532726    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g22wl\" (UniqueName: \"kubernetes.io/projected/3accfd04-ea30-4302-8d8d-416dd6de04e5-kube-api-access-g22wl\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.533007 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532737    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.533007 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532746    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3accfd04-ea30-4302-8d8d-416dd6de04e5-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.533007 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.532753    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3accfd04-ea30-4302-8d8d-416dd6de04e5-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:52:41.733432 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.733392    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"]
Jul 29 01:52:41.738789 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:41.738756    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-74571164-openshift-default-65858f45cb-g7qxc"]
Jul 29 01:52:43.545596 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:52:43.545553    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" path="/var/lib/kubelet/pods/3accfd04-ea30-4302-8d8d-416dd6de04e5/volumes"
Jul 29 01:54:15.810154 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:15.810122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:54:15.820517 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:15.820492    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:54:27.948786 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.948743    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"]
Jul 29 01:54:27.949449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949270    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy"
Jul 29 01:54:27.949449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949291    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy"
Jul 29 01:54:27.949449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949336    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy"
Jul 29 01:54:27.949449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949346    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy"
Jul 29 01:54:27.949449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy"
Jul 29 01:54:27.949449 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949365    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy"
Jul 29 01:54:27.949777 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949501    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy"
Jul 29 01:54:27.949777 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949514    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy"
Jul 29 01:54:27.949777 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949525    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97fbdce-42e4-4285-9f5d-482c15de2d92" containerName="istio-proxy"
Jul 29 01:54:27.949777 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.949535    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy"
Jul 29 01:54:27.952812 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.952786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:27.955340 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.955317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b88849d5-openshift-default-dockercfg-p8tn4\""
Jul 29 01:54:27.975294 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:27.975258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"]
Jul 29 01:54:28.005021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.004975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-data\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-certs\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-envoy\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istiod-ca-cert\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-credential-socket\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-podinfo\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005259 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-token\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005498 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzx88\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-kube-api-access-jzx88\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.005498 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.005366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-socket\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.106777 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.106719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-data\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.106997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.106793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-certs\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.106997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.106838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-envoy\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.106997 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.106972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istiod-ca-cert\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107228 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-credential-socket\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107228 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-podinfo\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107228 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-token\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107228 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzx88\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-kube-api-access-jzx88\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107446 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-data\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107446 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-socket\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107446 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-certs\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107591 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-credential-socket\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107591 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-socket\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.107746 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.107709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istiod-ca-cert\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.109652 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.109628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-envoy\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.109781 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.109764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-podinfo\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.116117 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.116079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-token\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.116465 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.116441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzx88\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-kube-api-access-jzx88\") pod \"e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") " pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.264073 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.263971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:28.419980 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.419946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"]
Jul 29 01:54:28.421303 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:54:28.421273    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5d180e_ef0d_4aab_baeb_a346b8a5c99a.slice/crio-ec15d5bc8b5aeff87bf7b2244c4da89ebab96e05bd435bf4df42909eaf1a1b96 WatchSource:0}: Error finding container ec15d5bc8b5aeff87bf7b2244c4da89ebab96e05bd435bf4df42909eaf1a1b96: Status 404 returned error can't find the container with id ec15d5bc8b5aeff87bf7b2244c4da89ebab96e05bd435bf4df42909eaf1a1b96
Jul 29 01:54:28.423651 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.423617    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:54:28.423759 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.423685    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:54:28.423759 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.423713    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:54:28.991211 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.991150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" event={"ID":"df5d180e-ef0d-4aab-baeb-a346b8a5c99a","Type":"ContainerStarted","Data":"0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"}
Jul 29 01:54:28.991648 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:28.991232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" event={"ID":"df5d180e-ef0d-4aab-baeb-a346b8a5c99a","Type":"ContainerStarted","Data":"ec15d5bc8b5aeff87bf7b2244c4da89ebab96e05bd435bf4df42909eaf1a1b96"}
Jul 29 01:54:29.011735 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:29.011675    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podStartSLOduration=2.011657679 podStartE2EDuration="2.011657679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:29.010540477 +0000 UTC m=+2713.972537510" watchObservedRunningTime="2026-07-29 01:54:29.011657679 +0000 UTC m=+2713.973654685"
Jul 29 01:54:29.264642 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:29.264542    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:29.269676 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:29.269643    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:29.996479 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:29.996447    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:29.997674 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:29.997652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:44.998345 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:44.998293    2563 patch_prober.go:28] interesting pod/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 01:54:44.998791 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:44.998374    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 01:54:45.087933 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:45.087894    2563 generic.go:356] "Generic (PLEG): container finished" podID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerID="0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044" exitCode=0
Jul 29 01:54:45.088150 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:45.087965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" event={"ID":"df5d180e-ef0d-4aab-baeb-a346b8a5c99a","Type":"ContainerDied","Data":"0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"}
Jul 29 01:54:45.088520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:45.088501    2563 scope.go:117] "RemoveContainer" containerID="0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"
Jul 29 01:54:45.089664 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:45.089631    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:54:45.089734 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:45.089717    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:54:45.089784 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:45.089771    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:54:46.095509 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:46.095468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" event={"ID":"df5d180e-ef0d-4aab-baeb-a346b8a5c99a","Type":"ContainerStarted","Data":"24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f"}
Jul 29 01:54:46.264217 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:46.264110    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:46.264433 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:46.264398    2563 patch_prober.go:28] interesting pod/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 01:54:46.264503 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:46.264440    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 01:54:47.264873 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:47.264832    2563 patch_prober.go:28] interesting pod/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 01:54:47.265324 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:47.264891    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 01:54:48.264930 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:48.264889    2563 patch_prober.go:28] interesting pod/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 01:54:48.265388 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:48.264952    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 01:54:49.265126 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:49.265080    2563 patch_prober.go:28] interesting pod/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 29 01:54:49.265614 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:49.265164    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 29 01:54:50.268928 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:50.268885    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:50.269471 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:50.269301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:54:50.270159 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:54:50.270140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:57:52.408554 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:52.408512    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"]
Jul 29 01:57:52.409163 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:52.408746    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy" containerID="cri-o://24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f" gracePeriod=30
Jul 29 01:57:57.676152 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.676063    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:57:57.727030 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.726989    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istiod-ca-cert\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727030 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-data\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727061    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-podinfo\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727090    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-certs\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzx88\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-kube-api-access-jzx88\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727176    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-credential-socket\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-token\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-envoy\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727334    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-socket\") pod \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\" (UID: \"df5d180e-ef0d-4aab-baeb-a346b8a5c99a\") "
Jul 29 01:57:57.727789 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727716    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:57:57.727789 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727747    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:57:57.727936 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:57:57.727936 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727851    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:57:57.728053 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.727976    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-data" (OuterVolumeSpecName: "istio-data") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:57:57.729688 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.729650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-kube-api-access-jzx88" (OuterVolumeSpecName: "kube-api-access-jzx88") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "kube-api-access-jzx88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:57:57.729809 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.729696    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-token" (OuterVolumeSpecName: "istio-token") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:57:57.729809 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.729732    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:57:57.729906 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.729886    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df5d180e-ef0d-4aab-baeb-a346b8a5c99a" (UID: "df5d180e-ef0d-4aab-baeb-a346b8a5c99a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:57:57.828920 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828874    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.828920 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828912    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.828920 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828921    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.828920 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828929    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.829247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828937    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.829247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828946    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.829247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828953    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.829247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828962    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:57.829247 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:57.828970    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzx88\" (UniqueName: \"kubernetes.io/projected/df5d180e-ef0d-4aab-baeb-a346b8a5c99a-kube-api-access-jzx88\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 29 01:57:58.112021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.111917    2563 generic.go:356] "Generic (PLEG): container finished" podID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerID="24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f" exitCode=0
Jul 29 01:57:58.112021 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.111973    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"
Jul 29 01:57:58.112271 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.112020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" event={"ID":"df5d180e-ef0d-4aab-baeb-a346b8a5c99a","Type":"ContainerDied","Data":"24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f"}
Jul 29 01:57:58.112271 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.112083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct" event={"ID":"df5d180e-ef0d-4aab-baeb-a346b8a5c99a","Type":"ContainerDied","Data":"ec15d5bc8b5aeff87bf7b2244c4da89ebab96e05bd435bf4df42909eaf1a1b96"}
Jul 29 01:57:58.112271 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.112113    2563 scope.go:117] "RemoveContainer" containerID="24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f"
Jul 29 01:57:58.122693 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.122672    2563 scope.go:117] "RemoveContainer" containerID="0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"
Jul 29 01:57:58.132520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.132495    2563 scope.go:117] "RemoveContainer" containerID="24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f"
Jul 29 01:57:58.132866 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:57:58.132839    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f\": container with ID starting with 24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f not found: ID does not exist" containerID="24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f"
Jul 29 01:57:58.132940 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.132876    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f"} err="failed to get container status \"24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f\": rpc error: code = NotFound desc = could not find container \"24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f\": container with ID starting with 24fb4fb3407cf65d8c272f4d1bbe4b20904cb300f4c23d99ebe591304263e76f not found: ID does not exist"
Jul 29 01:57:58.132940 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.132896    2563 scope.go:117] "RemoveContainer" containerID="0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"
Jul 29 01:57:58.133286 ip-10-0-139-48 kubenswrapper[2563]: E0729 01:57:58.133175    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044\": container with ID starting with 0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044 not found: ID does not exist" containerID="0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"
Jul 29 01:57:58.133338 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.133295    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044"} err="failed to get container status \"0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044\": rpc error: code = NotFound desc = could not find container \"0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044\": container with ID starting with 0a53c9a3e2a67d7a76433bfa62d264ae47b0ddb274975797ea8ef7984b537044 not found: ID does not exist"
Jul 29 01:57:58.138024 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.137987    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"]
Jul 29 01:57:58.143307 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:58.143274    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b88849d5-openshift-default-69fccbdd84-8vkct"]
Jul 29 01:57:59.545733 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:59.545684    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" path="/var/lib/kubelet/pods/df5d180e-ef0d-4aab-baeb-a346b8a5c99a/volumes"
Jul 29 01:57:59.652490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:59.652452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bnsbx_9975c4b5-754c-4fea-b382-1b9db1364c92/manager/0.log"
Jul 29 01:57:59.779800 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:59.779759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-9njpd_3d99a0fb-ec81-46d6-b188-b57e251739ca/manager/0.log"
Jul 29 01:57:59.786847 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:57:59.786817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-9njpd_3d99a0fb-ec81-46d6-b188-b57e251739ca/copy-manifests/0.log"
Jul 29 01:58:00.438223 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:00.438169    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6fd655db7f-sblhm_750763c2-aec0-475a-a191-b2024da1d8d9/maas-api/0.log"
Jul 29 01:58:00.572287 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:00.572250    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754810-888sd_8128a63e-f173-40ac-be25-9a2784f0bb33/cleanup/0.log"
Jul 29 01:58:03.628948 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:03.628906    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777bvnxg_d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5/istio-proxy/0.log"
Jul 29 01:58:03.768355 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:03.768311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-snmbz_41e15d4e-af88-4026-86d6-388ead5073bc/discovery/0.log"
Jul 29 01:58:04.145516 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:04.145481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/1.log"
Jul 29 01:58:04.908494 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:04.908445    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xdzjf_520791c7-3701-4546-b4b5-98307ebe35d0/main/0.log"
Jul 29 01:58:14.563120 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:14.563087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2gbcw_28a2b89c-1ac3-4a6f-93aa-1d76e603286d/global-pull-secret-syncer/0.log"
Jul 29 01:58:14.753858 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:14.753805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g7pms_e08ee925-2bdf-440b-b76f-189cebc8b23f/konnectivity-agent/0.log"
Jul 29 01:58:14.864520 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:14.864389    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-48.ec2.internal_48f231bcc996df8559b089b6a3f5330f/haproxy/0.log"
Jul 29 01:58:22.276561 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.276524    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/alertmanager/0.log"
Jul 29 01:58:22.305381 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.305351    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/config-reloader/0.log"
Jul 29 01:58:22.330406 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.330369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/kube-rbac-proxy-web/0.log"
Jul 29 01:58:22.356131 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.356101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/kube-rbac-proxy/0.log"
Jul 29 01:58:22.387900 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.387863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/kube-rbac-proxy-metric/0.log"
Jul 29 01:58:22.413096 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.413069    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/prom-label-proxy/0.log"
Jul 29 01:58:22.438369 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.438340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7df682a0-4dab-4bea-9654-9ed313b2a401/init-config-reloader/0.log"
Jul 29 01:58:22.508868 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.508835    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rvcmv_bd0ca93d-e812-4100-9864-49ff1dcc0dff/kube-state-metrics/0.log"
Jul 29 01:58:22.533433 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.533346    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rvcmv_bd0ca93d-e812-4100-9864-49ff1dcc0dff/kube-rbac-proxy-main/0.log"
Jul 29 01:58:22.561742 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.561705    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rvcmv_bd0ca93d-e812-4100-9864-49ff1dcc0dff/kube-rbac-proxy-self/0.log"
Jul 29 01:58:22.654496 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.654457    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vfc2_c081c6a0-a010-41e4-888b-ce445d719c27/node-exporter/0.log"
Jul 29 01:58:22.677574 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.677546    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vfc2_c081c6a0-a010-41e4-888b-ce445d719c27/kube-rbac-proxy/0.log"
Jul 29 01:58:22.705085 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:22.705049    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vfc2_c081c6a0-a010-41e4-888b-ce445d719c27/init-textfile/0.log"
Jul 29 01:58:23.216805 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:23.216773    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8slr8_f39816d9-cf76-4519-a696-4146edf0aea7/prometheus-operator/0.log"
Jul 29 01:58:23.244330 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:23.244301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8slr8_f39816d9-cf76-4519-a696-4146edf0aea7/kube-rbac-proxy/0.log"
Jul 29 01:58:24.202065 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202025    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"]
Jul 29 01:58:24.202490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202418    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy"
Jul 29 01:58:24.202490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202432    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3accfd04-ea30-4302-8d8d-416dd6de04e5" containerName="istio-proxy"
Jul 29 01:58:24.202490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202461    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy"
Jul 29 01:58:24.202490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202467    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy"
Jul 29 01:58:24.202490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202475    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy"
Jul 29 01:58:24.202490 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202481    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy"
Jul 29 01:58:24.202695 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.202543    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5d180e-ef0d-4aab-baeb-a346b8a5c99a" containerName="istio-proxy"
Jul 29 01:58:24.207354 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.207330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.210009 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.209974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rr4h4\"/\"kube-root-ca.crt\""
Jul 29 01:58:24.210208 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.209982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rr4h4\"/\"openshift-service-ca.crt\""
Jul 29 01:58:24.210761 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.210744    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rr4h4\"/\"default-dockercfg-vd84j\""
Jul 29 01:58:24.217116 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.217082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"]
Jul 29 01:58:24.286577 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.286538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-podres\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.286577 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.286577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-sys\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.286856 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.286599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl82l\" (UniqueName: \"kubernetes.io/projected/875c72c0-8568-4514-bc6b-490086d2b9ea-kube-api-access-jl82l\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.286856 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.286685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-lib-modules\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.286856 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.286741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-proc\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388140 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-podres\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388140 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-sys\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl82l\" (UniqueName: \"kubernetes.io/projected/875c72c0-8568-4514-bc6b-490086d2b9ea-kube-api-access-jl82l\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-lib-modules\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-proc\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-sys\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-podres\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388437 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-proc\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.388636 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.388442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/875c72c0-8568-4514-bc6b-490086d2b9ea-lib-modules\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.397701 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.397664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl82l\" (UniqueName: \"kubernetes.io/projected/875c72c0-8568-4514-bc6b-490086d2b9ea-kube-api-access-jl82l\") pod \"perf-node-gather-daemonset-swd28\" (UID: \"875c72c0-8568-4514-bc6b-490086d2b9ea\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.519253 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.519139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:24.665327 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.665280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"]
Jul 29 01:58:24.668566 ip-10-0-139-48 kubenswrapper[2563]: W0729 01:58:24.668529    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod875c72c0_8568_4514_bc6b_490086d2b9ea.slice/crio-2467b544bef1582fcc467afdf3c6983f473ea812f21070c7e364c6481bc59eab WatchSource:0}: Error finding container 2467b544bef1582fcc467afdf3c6983f473ea812f21070c7e364c6481bc59eab: Status 404 returned error can't find the container with id 2467b544bef1582fcc467afdf3c6983f473ea812f21070c7e364c6481bc59eab
Jul 29 01:58:24.781221 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:24.781093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-597h6_6a7ffbea-57e3-49a4-8c7c-686251a9111e/networking-console-plugin/0.log"
Jul 29 01:58:25.251785 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:25.251750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28" event={"ID":"875c72c0-8568-4514-bc6b-490086d2b9ea","Type":"ContainerStarted","Data":"4de205e1c255af47e0e9952d1e4d58d0847f2f10b70cb1180159cd6806b91735"}
Jul 29 01:58:25.252224 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:25.251826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28" event={"ID":"875c72c0-8568-4514-bc6b-490086d2b9ea","Type":"ContainerStarted","Data":"2467b544bef1582fcc467afdf3c6983f473ea812f21070c7e364c6481bc59eab"}
Jul 29 01:58:25.252224 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:25.251854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:25.269888 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:25.269827    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28" podStartSLOduration=1.269804596 podStartE2EDuration="1.269804596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:58:25.268762511 +0000 UTC m=+2950.230759519" watchObservedRunningTime="2026-07-29 01:58:25.269804596 +0000 UTC m=+2950.231801603"
Jul 29 01:58:25.384891 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:25.384851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/1.log"
Jul 29 01:58:25.394318 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:25.394282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-j4vgn_dea64566-9623-486c-9232-8237e03de953/console-operator/2.log"
Jul 29 01:58:26.011444 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:26.011395    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-zgmsj_10e34f2e-caf3-4fb9-b78e-70c977aa4193/download-server/0.log"
Jul 29 01:58:26.597981 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:26.597946    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-d6ltf_4b3f991a-542d-46dd-a018-ff5ad006f45f/volume-data-source-validator/0.log"
Jul 29 01:58:27.670410 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:27.670373    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z64kk_dac8e08e-8f19-430f-b101-a08c3259fc5a/dns/0.log"
Jul 29 01:58:27.690727 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:27.690689    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z64kk_dac8e08e-8f19-430f-b101-a08c3259fc5a/kube-rbac-proxy/0.log"
Jul 29 01:58:27.714306 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:27.714251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4hggq_72029676-fdd6-4746-93ef-51b93cdea875/dns-node-resolver/0.log"
Jul 29 01:58:28.311578 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:28.311538    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5jxs_4ce56aef-1689-4ec9-b2bd-687357a6a87a/node-ca/0.log"
Jul 29 01:58:29.316306 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:29.316274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777bvnxg_d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5/istio-proxy/0.log"
Jul 29 01:58:29.445052 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:29.445009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-snmbz_41e15d4e-af88-4026-86d6-388ead5073bc/discovery/0.log"
Jul 29 01:58:29.522621 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:29.522586    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/0.log"
Jul 29 01:58:29.576954 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:29.576854    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/1.log"
Jul 29 01:58:30.337584 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:30.337552    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tlrfb_8962e9cc-2da2-494b-b328-f64b0fb90b81/serve-healthcheck-canary/0.log"
Jul 29 01:58:30.816765 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:30.816736    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-j6h2q_8be3f6c9-65ba-4488-ad8f-776a8fc702c7/insights-operator/0.log"
Jul 29 01:58:30.818060 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:30.818029    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-j6h2q_8be3f6c9-65ba-4488-ad8f-776a8fc702c7/insights-operator/1.log"
Jul 29 01:58:30.838257 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:30.838226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d5t74_6d490e5b-ff8a-4e88-bf0f-a2a037388bab/kube-rbac-proxy/0.log"
Jul 29 01:58:30.859895 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:30.859863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d5t74_6d490e5b-ff8a-4e88-bf0f-a2a037388bab/exporter/0.log"
Jul 29 01:58:30.882662 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:30.882631    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d5t74_6d490e5b-ff8a-4e88-bf0f-a2a037388bab/extractor/0.log"
Jul 29 01:58:31.266681 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:31.266647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-swd28"
Jul 29 01:58:33.652421 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:33.652381    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bnsbx_9975c4b5-754c-4fea-b382-1b9db1364c92/manager/0.log"
Jul 29 01:58:33.678881 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:33.678828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-9njpd_3d99a0fb-ec81-46d6-b188-b57e251739ca/manager/0.log"
Jul 29 01:58:33.698982 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:33.698946    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-9njpd_3d99a0fb-ec81-46d6-b188-b57e251739ca/copy-manifests/0.log"
Jul 29 01:58:34.254347 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:34.254310    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777bvnxg_d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5/istio-proxy/0.log"
Jul 29 01:58:34.380871 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:34.380828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-snmbz_41e15d4e-af88-4026-86d6-388ead5073bc/discovery/0.log"
Jul 29 01:58:34.459732 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:34.459666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/0.log"
Jul 29 01:58:34.514441 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:34.514339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/1.log"
Jul 29 01:58:35.230312 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:35.230277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-588fcb66d4-b9lkd_fa8c2abb-68e2-4366-aeff-b81d22318bdc/manager/0.log"
Jul 29 01:58:35.299805 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:35.299769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8kzgk_67edabd3-a29f-4cd1-ae20-8333194bd865/openshift-lws-operator/0.log"
Jul 29 01:58:35.851622 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:35.851505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55c64bf777bvnxg_d6e7593f-7b89-4ada-a5b7-2a9e2e3f40c5/istio-proxy/0.log"
Jul 29 01:58:35.969515 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:35.969475    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-snmbz_41e15d4e-af88-4026-86d6-388ead5073bc/discovery/0.log"
Jul 29 01:58:36.024676 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:36.024626    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/0.log"
Jul 29 01:58:36.078978 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:36.078946    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5fddf99bfd-vkjbr_04c49a4e-e76d-4069-8b66-3bec19bed147/istio-proxy/1.log"
Jul 29 01:58:39.962148 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:39.962111    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xtgz2_a4259daa-3aa0-430b-bc3e-b5e9aacab2ed/migrator/0.log"
Jul 29 01:58:39.986240 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:39.986177    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xtgz2_a4259daa-3aa0-430b-bc3e-b5e9aacab2ed/graceful-termination/0.log"
Jul 29 01:58:40.336860 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:40.336746    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft_93314bb5-d56d-4077-bccc-e9a739d7ef10/kube-storage-version-migrator-operator/1.log"
Jul 29 01:58:40.338726 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:40.338695    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-ps2ft_93314bb5-d56d-4077-bccc-e9a739d7ef10/kube-storage-version-migrator-operator/0.log"
Jul 29 01:58:41.255793 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.255757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2vdwn_145a696f-67d9-4dbb-b23c-96cb743856a4/kube-multus/0.log"
Jul 29 01:58:41.698640 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.698610    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/kube-multus-additional-cni-plugins/0.log"
Jul 29 01:58:41.721861 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.721833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/egress-router-binary-copy/0.log"
Jul 29 01:58:41.747384 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.747347    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/cni-plugins/0.log"
Jul 29 01:58:41.769544 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.769473    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/bond-cni-plugin/0.log"
Jul 29 01:58:41.790371 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.790335    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/routeoverride-cni/0.log"
Jul 29 01:58:41.811564 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.811529    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/whereabouts-cni-bincopy/0.log"
Jul 29 01:58:41.832263 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.832228    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9fc8_50bb53b8-c7b0-43de-8f1c-e7fc63e1351c/whereabouts-cni/0.log"
Jul 29 01:58:41.983771 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:41.983673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z4z76_4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce/network-metrics-daemon/0.log"
Jul 29 01:58:42.002737 ip-10-0-139-48 kubenswrapper[2563]: I0729 01:58:42.002706    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z4z76_4d98c50a-a3c7-4b7a-ba69-d98afb2ca3ce/kube-rbac-proxy/0.log"