Jun 11 23:07:18.889144 ip-10-0-134-77 systemd[1]: Starting Kubernetes Kubelet... Jun 11 23:07:19.235918 ip-10-0-134-77 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:07:19.235918 ip-10-0-134-77 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 23:07:19.235918 ip-10-0-134-77 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:07:19.235918 ip-10-0-134-77 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 23:07:19.235918 ip-10-0-134-77 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:07:19.237528 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.237383 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 23:07:19.241483 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241453 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:19.241483 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241483 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241492 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241497 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241502 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241509 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241514 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241519 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241523 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241528 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241533 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241538 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241543 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241553 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241558 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241562 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241564 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241571 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241575 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241579 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241582 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:19.241616 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241585 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241589 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241612 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241718 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241724 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241729 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241734 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241737 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241740 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241743 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241746 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241748 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241751 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241754 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241756 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241759 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241764 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241767 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241769 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241772 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:19.242108 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241775 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241777 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241780 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241782 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241785 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241787 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241794 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241799 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241803 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241806 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241809 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241812 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241814 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241817 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241838 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241842 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241845 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241849 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241852 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:19.242589 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241854 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241857 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241860 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241863 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241865 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241868 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241870 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241873 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241875 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241878 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241881 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241883 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241889 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241893 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241896 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241898 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241901 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241903 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241906 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241909 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:19.243105 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241912 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241915 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241917 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241921 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241924 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241926 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241929 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241932 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241935 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241938 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241941 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241943 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241946 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241948 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241951 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241954 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241956 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241959 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.241962 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242681 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:19.243581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242687 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242691 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242693 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242696 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242699 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242707 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242709 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242712 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242715 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242717 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242720 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242725 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242729 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242733 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242736 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242739 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242743 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242745 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242748 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:19.244076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242752 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242755 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242758 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242760 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242763 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242765 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242768 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242771 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242773 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242776 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242778 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242781 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242784 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242788 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242792 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242794 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242797 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242800 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242802 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:19.244559 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242804 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242807 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242809 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242812 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242814 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242817 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242820 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242842 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242844 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242847 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242850 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242853 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242856 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242859 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242862 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242865 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242868 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242871 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242873 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242876 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:19.245043 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242879 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242882 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242884 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242888 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242893 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242896 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242899 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242902 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242904 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242908 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242912 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242915 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242918 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242921 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242924 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242927 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242930 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242932 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242935 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:19.245522 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242937 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242940 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242942 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242945 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242947 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242951 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242954 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242956 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242959 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242961 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242964 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242966 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242969 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242971 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242974 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242976 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242979 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242983 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242986 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242988 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:19.246000 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.242991 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243386 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243391 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243393 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243396 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243399 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243402 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243405 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243407 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243410 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243413 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243415 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243418 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243420 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243423 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243426 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243428 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243431 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243434 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243436 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:19.246469 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243439 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243442 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243445 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243447 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243450 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243452 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243454 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243457 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243460 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243464 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243466 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243469 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243471 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243474 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243477 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243481 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243484 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243486 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243490 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243494 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:19.246968 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243497 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243500 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243503 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243505 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243508 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243511 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243513 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243516 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243519 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243521 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243525 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243528 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243530 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243534 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243536 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243539 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243541 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243544 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243546 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243548 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:19.247458 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243551 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243556 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243559 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243562 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243565 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243567 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243570 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243574 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243576 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243579 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243583 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243593 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243596 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243598 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243601 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243604 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243607 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243609 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243612 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:19.247992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243614 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243617 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243620 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243622 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243626 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243628 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243631 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243633 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243636 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243638 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243640 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243643 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243645 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243648 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243652 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243654 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243657 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243659 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243662 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:19.248456 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243664 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.243668 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243738 2571 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243745 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243753 2571 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243759 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243766 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243770 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243776 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243781 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243784 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243787 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243791 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243794 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243797 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243800 2571 flags.go:64] FLAG: --cgroup-root="" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243803 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243806 2571 flags.go:64] FLAG: --client-ca-file="" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243810 2571 flags.go:64] FLAG: --cloud-provider="external" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243813 2571 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243817 2571 flags.go:64] FLAG: --cluster-domain="" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243835 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243839 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243843 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 23:07:19.248937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243846 2571 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243850 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243853 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243858 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243861 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243864 2571 flags.go:64] FLAG: --contention-profiling="false" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243867 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243870 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243874 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243879 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243883 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243886 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243889 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243892 2571 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243895 2571 flags.go:64] FLAG: --enable-server="true" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243898 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243902 2571 flags.go:64] FLAG: --event-burst="100" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243905 2571 flags.go:64] FLAG: --event-qps="50" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243908 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243911 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243914 2571 flags.go:64] FLAG: --eviction-hard="" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243918 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243921 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243923 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243926 2571 flags.go:64] FLAG: --eviction-soft="" Jun 11 23:07:19.249580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243929 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243932 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243939 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243942 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243944 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243947 2571 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243950 2571 flags.go:64] FLAG: --feature-gates="" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243954 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243957 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243960 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243964 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243967 2571 flags.go:64] FLAG: --healthz-port="10248" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243970 2571 flags.go:64] FLAG: --help="false" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243973 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243976 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243979 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243984 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243988 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243991 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243994 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243996 2571 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.243999 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244002 2571 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 23:07:19.250235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244005 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244008 2571 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244011 2571 flags.go:64] FLAG: --kube-reserved="" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244013 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244016 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244019 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244022 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244025 2571 flags.go:64] FLAG: --lock-file="" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244027 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244030 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244033 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244039 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244042 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244045 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244047 2571 flags.go:64] FLAG: --logging-format="text" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244050 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244053 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244056 2571 flags.go:64] FLAG: --manifest-url="" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244059 2571 flags.go:64] FLAG: --manifest-url-header="" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244065 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244068 2571 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244072 2571 flags.go:64] FLAG: --max-pods="110" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244075 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244078 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244081 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 23:07:19.250847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244085 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244089 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244092 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244095 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244102 2571 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244105 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244108 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244111 2571 flags.go:64] FLAG: --pod-cidr="" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244114 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244120 2571 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244123 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244126 2571 flags.go:64] FLAG: --pods-per-core="0" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244129 2571 flags.go:64] FLAG: --port="10250" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244132 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244135 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01780a1ca0adc1182" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244138 2571 flags.go:64] FLAG: --qos-reserved="" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244141 2571 flags.go:64] FLAG: --read-only-port="10255" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244144 2571 flags.go:64] FLAG: --register-node="true" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244148 2571 flags.go:64] FLAG: --register-with-taints="" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244151 2571 flags.go:64] FLAG: --registry-burst="10" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244155 2571 flags.go:64] FLAG: --registry-qps="5" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244158 2571 flags.go:64] FLAG: --reserved-cpus="" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244161 2571 flags.go:64] FLAG: --reserved-memory="" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244164 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244167 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 23:07:19.251484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244171 2571 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244173 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244177 2571 flags.go:64] FLAG: --runonce="false" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244180 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244183 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244186 2571 flags.go:64] FLAG: --seccomp-default="false" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244189 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244192 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244195 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244198 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244201 2571 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244204 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244207 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244210 2571 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244213 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244216 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244218 2571 flags.go:64] FLAG: --system-cgroups="" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244221 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244226 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244229 2571 flags.go:64] FLAG: --tls-cert-file="" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244231 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244236 2571 flags.go:64] FLAG: --tls-min-version="" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244239 2571 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244241 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244244 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 23:07:19.252117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244247 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244250 2571 flags.go:64] FLAG: --v="2" Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244254 2571 flags.go:64] FLAG: --version="false" Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244258 2571 flags.go:64] FLAG: --vmodule="" Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244262 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.244265 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244381 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244384 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244388 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244391 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244394 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244396 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244399 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244402 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244405 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244408 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244410 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244413 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244415 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244419 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244421 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:19.252738 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244424 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244426 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244429 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244431 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244434 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244436 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244439 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244442 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244444 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244448 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244450 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244453 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244455 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244458 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244461 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244464 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244466 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244469 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244471 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244474 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:19.253271 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244477 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244479 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244481 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244484 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244486 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244489 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244491 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244494 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244497 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244499 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244501 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244504 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244506 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244509 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244511 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244514 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244516 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244519 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244521 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:19.253764 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244524 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244528 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244532 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244536 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244539 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244542 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244545 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244547 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244549 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244552 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244555 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244559 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244563 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244566 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244568 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244571 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244574 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244576 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:19.254308 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244579 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244582 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244584 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244587 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244589 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244592 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244594 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244597 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244599 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244602 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244604 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244607 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244609 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244612 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244614 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244617 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244619 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244622 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244624 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244627 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:19.254748 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244631 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244633 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244636 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244639 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244641 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244644 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.244647 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.245249 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.253586 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.253603 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.254243 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.254251 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254317 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254322 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:19.255246 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254326 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254329 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254333 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254336 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254339 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254344 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254348 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254351 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254354 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254357 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254360 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254363 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254366 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254368 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254371 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254374 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254376 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254379 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254382 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254385 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:19.255599 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254387 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254390 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254393 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254395 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254398 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254400 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254403 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254408 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254411 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254414 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254416 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254419 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254422 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254425 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254427 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254430 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254432 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254435 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254438 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:19.256110 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254440 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254443 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254445 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254448 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254450 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254453 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254456 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254458 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254461 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254464 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254466 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254469 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254473 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254477 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254479 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254483 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254486 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254488 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254491 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:19.256581 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254494 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254498 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254501 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254504 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254507 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254509 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254512 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254514 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254517 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254519 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254522 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254525 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254527 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254530 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254532 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254535 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254538 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254540 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254544 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:19.257138 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254547 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254550 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254553 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254555 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254558 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254560 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254563 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254566 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254568 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254571 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254573 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254576 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254579 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254582 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254585 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254587 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254590 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254593 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254596 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:19.257607 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254598 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.254603 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254733 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254738 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254741 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254744 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254747 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254750 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254753 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254756 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254758 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254763 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254766 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254769 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254772 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:07:19.258080 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254775 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254778 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254780 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254783 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254785 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254788 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254790 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254793 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254795 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254798 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254801 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254803 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254807 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254810 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254812 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254816 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254818 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254835 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254838 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254841 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:07:19.258440 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254843 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254846 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254849 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254851 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254854 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254856 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254859 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254862 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254865 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254867 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254871 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254873 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254876 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254879 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254882 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254884 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254887 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254889 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254892 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254894 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:07:19.258936 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254897 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254900 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254902 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254905 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254909 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254913 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254916 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254918 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254922 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254924 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254927 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254930 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254933 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254935 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254938 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254940 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254943 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254945 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254948 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:07:19.259426 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254950 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254953 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254956 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254959 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254961 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254963 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254966 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254969 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254971 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254973 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254976 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254978 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254981 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254983 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254986 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254988 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254991 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254993 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.254998 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:07:19.259894 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255001 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255004 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255007 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255010 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255013 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255016 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255019 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:19.255021 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.255027 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.255154 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.257169 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.258453 2571 server.go:1019] "Starting client certificate rotation" Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.258562 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:07:19.260394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.258598 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:07:19.260992 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.260977 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:07:19.266538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.266513 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:07:19.278005 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.277976 2571 log.go:25] "Validated CRI v1 runtime API" Jun 11 23:07:19.280875 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.280858 2571 log.go:25] "Validated CRI v1 image API" Jun 11 23:07:19.282464 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.282435 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 23:07:19.285734 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.285716 2571 fs.go:135] Filesystem UUIDs: map[0fa921ea-cfa5-4218-a757-d8be9ddf2a0b:/dev/nvme0n1p3 5c34f87c-bb8e-433c-b1c3-b201227b250d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 23:07:19.285803 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.285734 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 23:07:19.291017 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.290881 2571 manager.go:216] Machine: {Timestamp:2026-06-11 23:07:19.28969182 +0000 UTC m=+0.295129660 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106788 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2757f37aa4d22ff04c242211ef3137 SystemUUID:ec2757f3-7aa4-d22f-f04c-242211ef3137 BootID:4837f0e5-86ce-4897-bf62-80c256e84979 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:40:23:f1:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:40:23:f1:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:40:83:bf:75:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 23:07:19.291017 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.290995 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:07:19.291159 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.291003 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 23:07:19.291194 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.291171 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 23:07:19.293675 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.293653 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 23:07:19.293820 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.293678 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 23:07:19.294503 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.294493 2571 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 23:07:19.294538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.294506 2571 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 23:07:19.294538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.294514 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:07:19.294538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.294528 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:07:19.295742 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.295732 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 23:07:19.298484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298473 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:07:19.298628 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298619 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 23:07:19.298659 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298650 2571 kubelet.go:486] "Attempting to sync node with API server" Jun 11 23:07:19.298690 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298664 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 23:07:19.298690 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298679 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 23:07:19.298749 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298693 2571 kubelet.go:398] "Adding apiserver pod source" Jun 11 23:07:19.298749 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.298702 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 23:07:19.299120 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.299108 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:07:19.299158 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.299128 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:07:19.301643 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.301626 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 23:07:19.303212 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303199 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 23:07:19.303266 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303230 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 23:07:19.303394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303384 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 23:07:19.303424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303398 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 23:07:19.303424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303405 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 23:07:19.303424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303411 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 23:07:19.303424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303419 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 23:07:19.303424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303424 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 23:07:19.303910 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303900 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 23:07:19.303941 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303911 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 23:07:19.303941 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303918 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 23:07:19.303941 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303923 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 23:07:19.303941 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303931 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 23:07:19.303941 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.303939 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 23:07:19.304788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.304778 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 23:07:19.304837 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.304789 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 23:07:19.308125 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.308112 2571 server.go:1268] "Started kubelet" Jun 11 23:07:19.308278 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.308222 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 23:07:19.308881 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.308797 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 23:07:19.308967 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.308924 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 23:07:19.309078 ip-10-0-134-77 systemd[1]: Started Kubernetes Kubelet. Jun 11 23:07:19.312387 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.312367 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 23:07:19.312626 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.312609 2571 server.go:310] "Adding debug handlers to kubelet server" Jun 11 23:07:19.313739 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.313714 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 23:07:19.314480 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.314459 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5nb5v" Jun 11 23:07:19.315956 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.315939 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 23:07:19.319663 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.319646 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 23:07:19.319747 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.319668 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 23:07:19.319747 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.319743 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.320335 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320318 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 23:07:19.320579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320506 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 23:07:19.320579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320323 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 23:07:19.320579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320464 2571 factory.go:55] Registering systemd factory Jun 11 23:07:19.320579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320575 2571 factory.go:223] Registration of the systemd container factory successfully Jun 11 23:07:19.320817 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320782 2571 factory.go:153] Registering CRI-O factory Jun 11 23:07:19.320817 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320793 2571 reconstruct.go:97] "Volume reconstruction finished" Jun 11 23:07:19.320817 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320804 2571 reconciler.go:29] "Reconciler: start to sync state" Jun 11 23:07:19.320817 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320797 2571 factory.go:223] Registration of the crio container factory successfully Jun 11 23:07:19.321027 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320898 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 23:07:19.321027 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320922 2571 factory.go:103] Registering Raw factory Jun 11 23:07:19.321027 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.320936 2571 manager.go:1196] Started watching for new ooms in manager Jun 11 23:07:19.321473 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.321461 2571 manager.go:349] Starting recovery of all containers Jun 11 23:07:19.323994 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.323964 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 23:07:19.324779 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.324734 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 23:07:19.324779 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.324732 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 23:07:19.331497 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.329286 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5nb5v" Jun 11 23:07:19.331497 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.330034 2571 manager.go:354] Recovery completed Jun 11 23:07:19.332066 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.332042 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 23:07:19.332788 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.331985 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b82975fa0cc2ba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-11 23:07:19.308083898 +0000 UTC m=+0.313521719,LastTimestamp:2026-06-11 23:07:19.308083898 +0000 UTC m=+0.313521719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 11 23:07:19.335378 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.335366 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.337381 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337359 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.337455 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337397 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.337455 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337408 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.337923 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337911 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 23:07:19.337923 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337920 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 23:07:19.338006 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337936 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:07:19.338006 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.337936 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.338987 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.338956 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.338987 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.338982 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.339102 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.338993 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.339102 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.339042 2571 policy_none.go:49] "None policy: Start" Jun 11 23:07:19.339102 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.339075 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 23:07:19.339102 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.339089 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 23:07:19.340590 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.340578 2571 policy_none.go:47] "Start" Jun 11 23:07:19.375461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.375442 2571 manager.go:337] "Starting Device Plugin manager" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.375479 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.375494 2571 server.go:87] "Starting device plugin registration server" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.375743 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.375756 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.375915 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.376016 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.376026 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.376583 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.376646 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.385734 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.386800 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.386857 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.386885 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.386918 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 23:07:19.390116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.388805 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:19.476013 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.475981 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.477093 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.477073 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.477199 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.477108 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.477199 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.477123 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.477199 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.477151 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.485447 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.485429 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.485559 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.485456 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-77.ec2.internal\": node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.487019 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.486968 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal"] Jun 11 23:07:19.487073 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.487030 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.488387 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.488371 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.488484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.488405 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.488484 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.488418 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.489696 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.489681 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.489811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.489797 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.489874 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.489842 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.490462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.490440 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.490462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.490463 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.490608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.490464 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.490608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.490476 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.490608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.490486 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.490608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.490496 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.491717 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.491700 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.491805 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.491730 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:07:19.493050 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.493034 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:07:19.493124 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.493066 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:07:19.493124 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.493080 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:07:19.509302 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.509280 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.517678 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.517657 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.522092 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.522069 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.522160 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.522097 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.522160 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.522100 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9d047301ade34e187f662d0538c7f23-config\") pod \"kube-apiserver-proxy-ip-10-0-134-77.ec2.internal\" (UID: \"b9d047301ade34e187f662d0538c7f23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.522160 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.522139 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.610105 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.610073 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.622375 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.622326 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9d047301ade34e187f662d0538c7f23-config\") pod \"kube-apiserver-proxy-ip-10-0-134-77.ec2.internal\" (UID: \"b9d047301ade34e187f662d0538c7f23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.622375 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.622378 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.622550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.622433 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9d047301ade34e187f662d0538c7f23-config\") pod \"kube-apiserver-proxy-ip-10-0-134-77.ec2.internal\" (UID: \"b9d047301ade34e187f662d0538c7f23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.622550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.622500 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.622550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.622534 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.622643 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.622562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.710696 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.710661 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.811517 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.811439 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:19.819613 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.819589 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.824859 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:19.824842 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 11 23:07:19.911818 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:19.911773 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:20.012332 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.012297 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:20.112924 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.112850 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 11 23:07:20.161703 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.161676 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:20.220427 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.220401 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 11 23:07:20.235038 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.235012 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:07:20.236468 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.236446 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 11 23:07:20.246126 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.246106 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:07:20.258225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.258205 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 23:07:20.258352 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.258337 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:07:20.258396 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.258372 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:07:20.299550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.299521 2571 apiserver.go:52] "Watching apiserver" Jun 11 23:07:20.312059 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.312032 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 23:07:20.312388 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.312367 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-pzjf7","openshift-multus/multus-additional-cni-plugins-ksgm8","openshift-multus/network-metrics-daemon-x4dj7","openshift-network-diagnostics/network-check-target-nc9v6","openshift-ovn-kubernetes/ovnkube-node-bxrrx","kube-system/global-pull-secret-syncer-gk96x","kube-system/konnectivity-agent-7p8mc","kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal","openshift-cluster-node-tuning-operator/tuned-crjk9","openshift-image-registry/node-ca-w6ztn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal","openshift-multus/multus-lzhsk","openshift-network-operator/iptables-alerter-5jqjh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb"] Jun 11 23:07:20.313619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.313598 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.314940 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.314920 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.316055 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.316036 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.316709 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.316501 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 23:07:20.316709 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.316509 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 23:07:20.316709 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.316509 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:20.316709 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.316508 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jvx8b\"" Jun 11 23:07:20.317175 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.317159 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.318057 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.317406 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k62w2\"" Jun 11 23:07:20.318057 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.317419 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 23:07:20.318057 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.317891 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:20.318057 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.317991 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:20.318323 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.318205 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.319626 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.319605 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.319907 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.319791 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 23:07:20.321473 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.321458 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.321676 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.321631 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.321993 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.321975 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 23:07:20.322074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.322027 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 23:07:20.322074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.322040 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dqtnk\"" Jun 11 23:07:20.322074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.322057 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 23:07:20.322212 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.322075 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 23:07:20.322354 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.322342 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.322406 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.322390 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:20.323508 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.323494 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.324793 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.324777 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.325222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.325205 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:20.325354 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.325340 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.325551 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.325531 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mwwtc\"" Jun 11 23:07:20.325628 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.325614 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.326245 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326227 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-etc-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326320 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326252 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-ovn\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326320 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326232 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.326402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326287 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-run-ovn-kubernetes\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326342 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/329364ee-d2da-48a8-8645-06fd73c6cbf9-konnectivity-ca\") pod \"konnectivity-agent-7p8mc\" (UID: \"329364ee-d2da-48a8-8645-06fd73c6cbf9\") " pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.326402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326370 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fe74b47-c9ad-43db-8404-1dc50b59ef05-host-slash\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.326402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326392 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-dbus\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.326634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326442 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.326634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326469 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.326634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326509 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-kubelet\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326537 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfcm\" (UniqueName: \"kubernetes.io/projected/259952ae-371d-4eb0-94bf-f5d5c1c44965-kube-api-access-pmfcm\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326587 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/329364ee-d2da-48a8-8645-06fd73c6cbf9-agent-certs\") pod \"konnectivity-agent-7p8mc\" (UID: \"329364ee-d2da-48a8-8645-06fd73c6cbf9\") " pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.326634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326615 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55zdj\" (UniqueName: \"kubernetes.io/projected/6fe74b47-c9ad-43db-8404-1dc50b59ef05-kube-api-access-55zdj\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326657 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-systemd-units\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326672 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-log-socket\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326689 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f78mc\" (UniqueName: \"kubernetes.io/projected/d131b1ac-7e95-40c6-8270-c2e0dad06d82-kube-api-access-f78mc\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326751 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-systemd\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326775 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326790 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-env-overrides\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326806 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326816 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovn-node-metrics-cert\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326863 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fe74b47-c9ad-43db-8404-1dc50b59ef05-iptables-alerter-script\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326886 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326902 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hgf29\"" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326909 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-run-netns\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326933 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.326976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.326958 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovnkube-config\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-var-lib-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327042 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-node-log\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327096 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-cni-bin\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327120 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovnkube-script-lib\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327142 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-slash\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327164 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327198 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-cni-netd\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.327477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-kubelet-config\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.327781 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.327765 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.328184 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.328167 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 23:07:20.328265 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.328212 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.328265 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.328228 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 23:07:20.329243 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.329227 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.331008 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.330372 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bd7r4\"" Jun 11 23:07:20.331008 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.330661 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.331008 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.330803 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.332210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332068 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2ktjn\"" Jun 11 23:07:20.332210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332086 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 23:07:20.332210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332151 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 23:07:20.332210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332164 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.332433 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332228 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 23:07:20.332433 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332299 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p2bmq\"" Jun 11 23:07:20.332433 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332327 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.332622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332532 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 23:07:20.332622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332539 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 23:07:20.332752 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.332661 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 23:07:20.333030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.333007 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vbqxc\"" Jun 11 23:07:20.333115 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.333029 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:02:19 +0000 UTC" deadline="2028-02-24 17:28:23.981885644 +0000 UTC" Jun 11 23:07:20.333115 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.333071 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14946h21m3.648818277s" Jun 11 23:07:20.334146 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.334130 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:07:20.353149 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.353115 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d047301ade34e187f662d0538c7f23.slice/crio-2b0dba98ee3716eedf406b6d163b38b0425e8c5f68c8b1306f013de00aa51178 WatchSource:0}: Error finding container 2b0dba98ee3716eedf406b6d163b38b0425e8c5f68c8b1306f013de00aa51178: Status 404 returned error can't find the container with id 2b0dba98ee3716eedf406b6d163b38b0425e8c5f68c8b1306f013de00aa51178 Jun 11 23:07:20.353379 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.353356 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6da1b13bca282ef865b3244f5b60b1.slice/crio-f8d8f58968e8827ae2c0d1c86e6835318ddb379dcd77603c28d34c32a399fa3f WatchSource:0}: Error finding container f8d8f58968e8827ae2c0d1c86e6835318ddb379dcd77603c28d34c32a399fa3f: Status 404 returned error can't find the container with id f8d8f58968e8827ae2c0d1c86e6835318ddb379dcd77603c28d34c32a399fa3f Jun 11 23:07:20.357052 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.356998 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x7plw" Jun 11 23:07:20.359928 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.359906 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:07:20.364577 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.364521 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x7plw" Jun 11 23:07:20.390266 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.390222 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" event={"ID":"b9d047301ade34e187f662d0538c7f23","Type":"ContainerStarted","Data":"2b0dba98ee3716eedf406b6d163b38b0425e8c5f68c8b1306f013de00aa51178"} Jun 11 23:07:20.391395 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.391344 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerStarted","Data":"f8d8f58968e8827ae2c0d1c86e6835318ddb379dcd77603c28d34c32a399fa3f"} Jun 11 23:07:20.421130 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.421102 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 23:07:20.427809 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427789 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fe74b47-c9ad-43db-8404-1dc50b59ef05-host-slash\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.427894 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427817 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysctl-d\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.427894 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427882 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fe74b47-c9ad-43db-8404-1dc50b59ef05-host-slash\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.427962 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427910 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-socket-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.427962 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427934 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlv4v\" (UniqueName: \"kubernetes.io/projected/da859842-bcbc-4668-8a66-5c4332b7c4ce-kube-api-access-rlv4v\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.427962 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427954 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a4fb35d-0821-4354-9fdf-f91fc3af357d-cni-binary-copy\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427967 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-k8s-cni-cncf-io\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.427985 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-kubelet\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428007 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysctl-conf\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.428074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428035 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-system-cni-dir\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.428074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428043 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-kubelet\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428059 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-sys-fs\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428080 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-log-socket\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428095 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-run\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428112 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-hosts-file\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428130 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdm4\" (UniqueName: \"kubernetes.io/projected/e15ca259-a328-4d71-8283-b2379cc88c39-kube-api-access-2hdm4\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428145 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-cni-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428158 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-hostroot\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428156 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-log-socket\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428176 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-env-overrides\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428198 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysconfig\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-var-lib-kubelet\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428228 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-multus-certs\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428245 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428272 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-run-netns\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428305 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-run-netns\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428398 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428421 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de5c634a-5ae9-4ca7-b9db-0539ef234807-serviceca\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428436 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-cnibin\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428451 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-var-lib-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428473 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-node-log\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428494 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36bb5554-d301-41e0-a6d3-75b051b97d9a-tmp\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428517 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-system-cni-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428522 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-var-lib-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428541 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428546 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-node-log\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428561 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-cni-netd\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428584 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-systemd\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428593 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-env-overrides\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428602 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-device-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-daemon-config\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.428786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-cni-netd\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428642 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428665 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-etc-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428692 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/329364ee-d2da-48a8-8645-06fd73c6cbf9-konnectivity-ca\") pod \"konnectivity-agent-7p8mc\" (UID: \"329364ee-d2da-48a8-8645-06fd73c6cbf9\") " pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428709 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428724 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-socket-dir-parent\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428738 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-etc-kubernetes\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428767 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-etc-openvswitch\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428859 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-dbus\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428915 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428956 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-tmp-dir\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.428981 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-cnibin\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429009 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429032 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-dbus\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429041 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.429069 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429063 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh65j\" (UniqueName: \"kubernetes.io/projected/4a4fb35d-0821-4354-9fdf-f91fc3af357d-kube-api-access-kh65j\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.429423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429104 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.429149 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:07:20.929115547 +0000 UTC m=+1.934553355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429171 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfcm\" (UniqueName: \"kubernetes.io/projected/259952ae-371d-4eb0-94bf-f5d5c1c44965-kube-api-access-pmfcm\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429211 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/329364ee-d2da-48a8-8645-06fd73c6cbf9-agent-certs\") pod \"konnectivity-agent-7p8mc\" (UID: \"329364ee-d2da-48a8-8645-06fd73c6cbf9\") " pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429233 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-os-release\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.429241 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429252 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55zdj\" (UniqueName: \"kubernetes.io/projected/6fe74b47-c9ad-43db-8404-1dc50b59ef05-kube-api-access-55zdj\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429273 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-systemd-units\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429354 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-systemd-units\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429396 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-lib-modules\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.429408 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:20.929390305 +0000 UTC m=+1.934828153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429238 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/329364ee-d2da-48a8-8645-06fd73c6cbf9-konnectivity-ca\") pod \"konnectivity-agent-7p8mc\" (UID: \"329364ee-d2da-48a8-8645-06fd73c6cbf9\") " pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-cni-bin\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429472 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-conf-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429500 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f78mc\" (UniqueName: \"kubernetes.io/projected/d131b1ac-7e95-40c6-8270-c2e0dad06d82-kube-api-access-f78mc\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429526 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-systemd\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429528 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429551 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovn-node-metrics-cert\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429576 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-os-release\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429584 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-systemd\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429604 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fe74b47-c9ad-43db-8404-1dc50b59ef05-iptables-alerter-script\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429629 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovnkube-config\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429693 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-modprobe-d\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429727 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-tuned\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429746 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvggx\" (UniqueName: \"kubernetes.io/projected/de5c634a-5ae9-4ca7-b9db-0539ef234807-kube-api-access-tvggx\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429762 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-kubelet\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-cni-bin\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429849 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovnkube-script-lib\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429850 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-cni-bin\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429874 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-kubernetes\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-host\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429959 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7464r\" (UniqueName: \"kubernetes.io/projected/36bb5554-d301-41e0-a6d3-75b051b97d9a-kube-api-access-7464r\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.429984 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.430741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-registration-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430041 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-netns\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430065 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-slash\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430089 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-kubelet-config\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430112 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-sys\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430134 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7lz\" (UniqueName: \"kubernetes.io/projected/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-kube-api-access-ph7lz\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-slash\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430157 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430160 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovnkube-config\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430204 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-kubelet-config\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430216 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430186 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fe74b47-c9ad-43db-8404-1dc50b59ef05-iptables-alerter-script\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430259 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-cni-multus\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430324 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-ovn\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430357 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovnkube-script-lib\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430356 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-run-ovn-kubernetes\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430380 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de5c634a-5ae9-4ca7-b9db-0539ef234807-host\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.431234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430400 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-run-ovn\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.431709 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.430428 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259952ae-371d-4eb0-94bf-f5d5c1c44965-host-run-ovn-kubernetes\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.433277 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.433250 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/259952ae-371d-4eb0-94bf-f5d5c1c44965-ovn-node-metrics-cert\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.433277 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.433276 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/329364ee-d2da-48a8-8645-06fd73c6cbf9-agent-certs\") pod \"konnectivity-agent-7p8mc\" (UID: \"329364ee-d2da-48a8-8645-06fd73c6cbf9\") " pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.436204 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.436189 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:20.436204 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.436208 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:20.436204 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.436217 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:20.436348 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.436271 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:20.936259048 +0000 UTC m=+1.941696859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:20.439019 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.438992 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f78mc\" (UniqueName: \"kubernetes.io/projected/d131b1ac-7e95-40c6-8270-c2e0dad06d82-kube-api-access-f78mc\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.439203 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.439186 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55zdj\" (UniqueName: \"kubernetes.io/projected/6fe74b47-c9ad-43db-8404-1dc50b59ef05-kube-api-access-55zdj\") pod \"iptables-alerter-5jqjh\" (UID: \"6fe74b47-c9ad-43db-8404-1dc50b59ef05\") " pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.439255 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.439236 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfcm\" (UniqueName: \"kubernetes.io/projected/259952ae-371d-4eb0-94bf-f5d5c1c44965-kube-api-access-pmfcm\") pod \"ovnkube-node-bxrrx\" (UID: \"259952ae-371d-4eb0-94bf-f5d5c1c44965\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.454584 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.454565 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:20.531524 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531489 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-kubernetes\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531524 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531524 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-host\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531539 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7464r\" (UniqueName: \"kubernetes.io/projected/36bb5554-d301-41e0-a6d3-75b051b97d9a-kube-api-access-7464r\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531570 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-registration-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531584 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-netns\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531628 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-host\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531643 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-registration-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531650 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-kubernetes\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531679 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-netns\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531679 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-sys\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531745 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7lz\" (UniqueName: \"kubernetes.io/projected/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-kube-api-access-ph7lz\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531771 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531776 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-sys\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531797 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.531815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531841 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-cni-multus\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531866 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de5c634a-5ae9-4ca7-b9db-0539ef234807-host\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531892 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysctl-d\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531912 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-socket-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531911 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-cni-multus\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531947 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de5c634a-5ae9-4ca7-b9db-0539ef234807-host\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.531987 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlv4v\" (UniqueName: \"kubernetes.io/projected/da859842-bcbc-4668-8a66-5c4332b7c4ce-kube-api-access-rlv4v\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532019 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a4fb35d-0821-4354-9fdf-f91fc3af357d-cni-binary-copy\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532043 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-k8s-cni-cncf-io\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532064 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysctl-d\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532068 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysctl-conf\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532075 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-socket-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532093 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-system-cni-dir\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532116 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-k8s-cni-cncf-io\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532117 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-sys-fs\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532156 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-run\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532158 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-system-cni-dir\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.532579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532177 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-hosts-file\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532201 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdm4\" (UniqueName: \"kubernetes.io/projected/e15ca259-a328-4d71-8283-b2379cc88c39-kube-api-access-2hdm4\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532221 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-sys-fs\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532227 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-cni-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532267 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-hostroot\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532278 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-cni-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532281 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysctl-conf\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysconfig\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532317 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-var-lib-kubelet\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532323 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-hostroot\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532346 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-multus-certs\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532358 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-hosts-file\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532366 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532321 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-run\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532371 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-var-lib-kubelet\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532386 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-sysconfig\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532503 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-run-multus-certs\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.533359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532534 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de5c634a-5ae9-4ca7-b9db-0539ef234807-serviceca\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532558 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-cnibin\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532566 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a4fb35d-0821-4354-9fdf-f91fc3af357d-cni-binary-copy\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532584 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36bb5554-d301-41e0-a6d3-75b051b97d9a-tmp\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532606 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-system-cni-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532610 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-cnibin\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532631 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-systemd\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532653 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-device-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532676 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-daemon-config\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532702 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532711 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-systemd\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532724 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-device-dir\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532678 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-system-cni-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-socket-dir-parent\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532772 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-etc-kubernetes\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532782 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-socket-dir-parent\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-tmp-dir\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532849 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-cnibin\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.534260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532875 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-etc-kubernetes\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532876 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532919 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de5c634a-5ae9-4ca7-b9db-0539ef234807-serviceca\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532924 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532935 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-cnibin\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532950 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh65j\" (UniqueName: \"kubernetes.io/projected/4a4fb35d-0821-4354-9fdf-f91fc3af357d-kube-api-access-kh65j\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532979 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-os-release\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.532997 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-lib-modules\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533028 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-cni-bin\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533041 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da859842-bcbc-4668-8a66-5c4332b7c4ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533056 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-conf-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533085 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-os-release\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533111 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-modprobe-d\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533135 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-tuned\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533142 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-lib-modules\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533142 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-tmp-dir\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533157 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvggx\" (UniqueName: \"kubernetes.io/projected/de5c634a-5ae9-4ca7-b9db-0539ef234807-kube-api-access-tvggx\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533182 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-kubelet\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533193 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-os-release\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533225 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-os-release\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533264 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-cni-bin\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533263 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-host-var-lib-kubelet\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533272 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-daemon-config\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-modprobe-d\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533316 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a4fb35d-0821-4354-9fdf-f91fc3af357d-multus-conf-dir\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533342 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e15ca259-a328-4d71-8283-b2379cc88c39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.533416 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e15ca259-a328-4d71-8283-b2379cc88c39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.535198 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36bb5554-d301-41e0-a6d3-75b051b97d9a-tmp\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.535617 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.535240 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36bb5554-d301-41e0-a6d3-75b051b97d9a-etc-tuned\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.540800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.540773 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdm4\" (UniqueName: \"kubernetes.io/projected/e15ca259-a328-4d71-8283-b2379cc88c39-kube-api-access-2hdm4\") pod \"multus-additional-cni-plugins-ksgm8\" (UID: \"e15ca259-a328-4d71-8283-b2379cc88c39\") " pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.541597 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.541578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7lz\" (UniqueName: \"kubernetes.io/projected/b92bb8ca-e3ea-4725-ba46-fa03d6f5db52-kube-api-access-ph7lz\") pod \"node-resolver-pzjf7\" (UID: \"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52\") " pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.542580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.542560 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7464r\" (UniqueName: \"kubernetes.io/projected/36bb5554-d301-41e0-a6d3-75b051b97d9a-kube-api-access-7464r\") pod \"tuned-crjk9\" (UID: \"36bb5554-d301-41e0-a6d3-75b051b97d9a\") " pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.542803 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.542787 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvggx\" (UniqueName: \"kubernetes.io/projected/de5c634a-5ae9-4ca7-b9db-0539ef234807-kube-api-access-tvggx\") pod \"node-ca-w6ztn\" (UID: \"de5c634a-5ae9-4ca7-b9db-0539ef234807\") " pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.542865 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.542810 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlv4v\" (UniqueName: \"kubernetes.io/projected/da859842-bcbc-4668-8a66-5c4332b7c4ce-kube-api-access-rlv4v\") pod \"aws-ebs-csi-driver-node-nt5zb\" (UID: \"da859842-bcbc-4668-8a66-5c4332b7c4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.543103 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.543087 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh65j\" (UniqueName: \"kubernetes.io/projected/4a4fb35d-0821-4354-9fdf-f91fc3af357d-kube-api-access-kh65j\") pod \"multus-lzhsk\" (UID: \"4a4fb35d-0821-4354-9fdf-f91fc3af357d\") " pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.642082 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.641996 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:20.650302 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.650276 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329364ee_d2da_48a8_8645_06fd73c6cbf9.slice/crio-7b4e5e0028a68b09a5c36e5b8952e262878b79892fda8e9171768e85ab46b66a WatchSource:0}: Error finding container 7b4e5e0028a68b09a5c36e5b8952e262878b79892fda8e9171768e85ab46b66a: Status 404 returned error can't find the container with id 7b4e5e0028a68b09a5c36e5b8952e262878b79892fda8e9171768e85ab46b66a Jun 11 23:07:20.653142 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.653123 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jqjh" Jun 11 23:07:20.659710 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.659693 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:20.659983 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.659960 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe74b47_c9ad_43db_8404_1dc50b59ef05.slice/crio-141cacd2fadf5c71c22ec5401632f5305106f0076578c1e652135ee78e00ed9d WatchSource:0}: Error finding container 141cacd2fadf5c71c22ec5401632f5305106f0076578c1e652135ee78e00ed9d: Status 404 returned error can't find the container with id 141cacd2fadf5c71c22ec5401632f5305106f0076578c1e652135ee78e00ed9d Jun 11 23:07:20.664209 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.664187 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crjk9" Jun 11 23:07:20.666699 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.666673 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259952ae_371d_4eb0_94bf_f5d5c1c44965.slice/crio-91bd79e752c7688bc25958b7c6580286b49d1564985041259404946e1c268f7d WatchSource:0}: Error finding container 91bd79e752c7688bc25958b7c6580286b49d1564985041259404946e1c268f7d: Status 404 returned error can't find the container with id 91bd79e752c7688bc25958b7c6580286b49d1564985041259404946e1c268f7d Jun 11 23:07:20.670917 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.670886 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bb5554_d301_41e0_a6d3_75b051b97d9a.slice/crio-cea40ebf0137cb9f42da81446052281737aa9ce2dc3e957fed581ba0b2608328 WatchSource:0}: Error finding container cea40ebf0137cb9f42da81446052281737aa9ce2dc3e957fed581ba0b2608328: Status 404 returned error can't find the container with id cea40ebf0137cb9f42da81446052281737aa9ce2dc3e957fed581ba0b2608328 Jun 11 23:07:20.671694 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.671676 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pzjf7" Jun 11 23:07:20.678584 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.678564 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" Jun 11 23:07:20.680539 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.680521 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92bb8ca_e3ea_4725_ba46_fa03d6f5db52.slice/crio-5207bab5c6692c73a8a308722a9d37e5d8bfa778c1d7801506e012be7935b445 WatchSource:0}: Error finding container 5207bab5c6692c73a8a308722a9d37e5d8bfa778c1d7801506e012be7935b445: Status 404 returned error can't find the container with id 5207bab5c6692c73a8a308722a9d37e5d8bfa778c1d7801506e012be7935b445 Jun 11 23:07:20.683028 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.682947 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w6ztn" Jun 11 23:07:20.685654 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.685625 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15ca259_a328_4d71_8283_b2379cc88c39.slice/crio-ab70b77d25322d3b14acfd80f5ce41a982ac11802c2e8f8a644a2a7710643290 WatchSource:0}: Error finding container ab70b77d25322d3b14acfd80f5ce41a982ac11802c2e8f8a644a2a7710643290: Status 404 returned error can't find the container with id ab70b77d25322d3b14acfd80f5ce41a982ac11802c2e8f8a644a2a7710643290 Jun 11 23:07:20.688471 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.688365 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" Jun 11 23:07:20.691042 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.691015 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5c634a_5ae9_4ca7_b9db_0539ef234807.slice/crio-8649171c4e3a9fcb4829036434bc88b9b2985915e941a07d59ee7d4dadd569c1 WatchSource:0}: Error finding container 8649171c4e3a9fcb4829036434bc88b9b2985915e941a07d59ee7d4dadd569c1: Status 404 returned error can't find the container with id 8649171c4e3a9fcb4829036434bc88b9b2985915e941a07d59ee7d4dadd569c1 Jun 11 23:07:20.693666 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.693645 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lzhsk" Jun 11 23:07:20.697187 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.697151 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda859842_bcbc_4668_8a66_5c4332b7c4ce.slice/crio-75ad9f424b83fde4ba0310eef9814f75ba5dbb23bab893febd3e681bba56ad4a WatchSource:0}: Error finding container 75ad9f424b83fde4ba0310eef9814f75ba5dbb23bab893febd3e681bba56ad4a: Status 404 returned error can't find the container with id 75ad9f424b83fde4ba0310eef9814f75ba5dbb23bab893febd3e681bba56ad4a Jun 11 23:07:20.704974 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:20.704947 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4fb35d_0821_4354_9fdf_f91fc3af357d.slice/crio-6b5519e1364355f03f36f24ec14849bea6bba487b6e79c44d6163020ca06a220 WatchSource:0}: Error finding container 6b5519e1364355f03f36f24ec14849bea6bba487b6e79c44d6163020ca06a220: Status 404 returned error can't find the container with id 6b5519e1364355f03f36f24ec14849bea6bba487b6e79c44d6163020ca06a220 Jun 11 23:07:20.937395 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.937299 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:20.937395 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.937360 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:20.937610 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:20.937425 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:20.937610 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937548 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:20.937610 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937550 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:20.937610 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937566 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:20.937610 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937580 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:20.937936 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937637 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:21.937602313 +0000 UTC m=+2.943040137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:20.937936 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937665 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:21.937648006 +0000 UTC m=+2.943085819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:20.937936 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937746 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:20.937936 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:20.937797 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:07:21.937784514 +0000 UTC m=+2.943222337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:21.367402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.367295 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:02:20 +0000 UTC" deadline="2028-03-14 15:40:02.677055988 +0000 UTC" Jun 11 23:07:21.367402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.367358 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15400h32m41.309702529s" Jun 11 23:07:21.390811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.390312 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:21.390811 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.390434 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:21.408061 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.408021 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerStarted","Data":"ab70b77d25322d3b14acfd80f5ce41a982ac11802c2e8f8a644a2a7710643290"} Jun 11 23:07:21.416869 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.416498 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"91bd79e752c7688bc25958b7c6580286b49d1564985041259404946e1c268f7d"} Jun 11 23:07:21.419918 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.419811 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jqjh" event={"ID":"6fe74b47-c9ad-43db-8404-1dc50b59ef05","Type":"ContainerStarted","Data":"141cacd2fadf5c71c22ec5401632f5305106f0076578c1e652135ee78e00ed9d"} Jun 11 23:07:21.436508 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.436473 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7p8mc" event={"ID":"329364ee-d2da-48a8-8645-06fd73c6cbf9","Type":"ContainerStarted","Data":"7b4e5e0028a68b09a5c36e5b8952e262878b79892fda8e9171768e85ab46b66a"} Jun 11 23:07:21.440476 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.440440 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lzhsk" event={"ID":"4a4fb35d-0821-4354-9fdf-f91fc3af357d","Type":"ContainerStarted","Data":"6b5519e1364355f03f36f24ec14849bea6bba487b6e79c44d6163020ca06a220"} Jun 11 23:07:21.446368 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.446328 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pzjf7" event={"ID":"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52","Type":"ContainerStarted","Data":"5207bab5c6692c73a8a308722a9d37e5d8bfa778c1d7801506e012be7935b445"} Jun 11 23:07:21.460134 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.460102 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crjk9" event={"ID":"36bb5554-d301-41e0-a6d3-75b051b97d9a","Type":"ContainerStarted","Data":"cea40ebf0137cb9f42da81446052281737aa9ce2dc3e957fed581ba0b2608328"} Jun 11 23:07:21.479344 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.479292 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" event={"ID":"da859842-bcbc-4668-8a66-5c4332b7c4ce","Type":"ContainerStarted","Data":"75ad9f424b83fde4ba0310eef9814f75ba5dbb23bab893febd3e681bba56ad4a"} Jun 11 23:07:21.482077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.482046 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w6ztn" event={"ID":"de5c634a-5ae9-4ca7-b9db-0539ef234807","Type":"ContainerStarted","Data":"8649171c4e3a9fcb4829036434bc88b9b2985915e941a07d59ee7d4dadd569c1"} Jun 11 23:07:21.654642 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.654440 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:21.946367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.946108 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:21.946367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.946203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:21.946367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:21.946248 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:21.946367 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946281 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:21.946367 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946372 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:23.946345533 +0000 UTC m=+4.951783357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:21.946739 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946398 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:21.946739 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946453 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:07:23.946435837 +0000 UTC m=+4.951873651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:21.946739 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946536 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:21.946739 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946549 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:21.946739 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946562 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:21.946739 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:21.946600 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:23.946587894 +0000 UTC m=+4.952025718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:22.368612 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:22.368498 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:02:20 +0000 UTC" deadline="2028-01-23 11:25:34.838442733 +0000 UTC" Jun 11 23:07:22.368612 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:22.368562 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14172h18m12.469884912s" Jun 11 23:07:22.388118 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:22.388082 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:22.388295 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:22.388220 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:22.388352 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:22.388306 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:22.388400 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:22.388389 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:22.557158 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:22.557127 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:07:23.389150 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:23.389121 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:23.389602 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.389255 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:23.962122 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:23.962180 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:23.962213 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.962352 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.962416 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:27.962397398 +0000 UTC m=+8.967835209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.962840 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.962864 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.962877 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.962923 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:27.962908846 +0000 UTC m=+8.968346657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.963002 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:23.963070 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:23.963035 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:07:27.963024802 +0000 UTC m=+8.968462612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:24.388632 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:24.387940 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:24.388632 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:24.388075 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:24.388632 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:24.388146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:24.388632 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:24.388234 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:25.387854 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:25.387796 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:25.388308 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:25.387953 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:26.388340 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:26.387863 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:26.388340 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:26.387903 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:26.388340 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:26.388015 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:26.388340 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:26.388151 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:27.387373 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:27.387335 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:27.387560 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.387481 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:27.996791 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:27.996748 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:27.996811 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.996936 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:27.996951 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.996963 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.996990 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.997005 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.997007 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:07:35.996985529 +0000 UTC m=+17.002423343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.997055 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.997062 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:35.997046938 +0000 UTC m=+17.002484766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:27.997288 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:27.997092 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:35.997081404 +0000 UTC m=+17.002519213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:28.387368 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:28.387282 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:28.387522 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:28.387413 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:28.387522 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:28.387429 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:28.387637 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:28.387525 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:29.389129 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:29.388660 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:29.389129 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:29.388773 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:30.388031 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:30.387991 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:30.388226 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:30.387991 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:30.388226 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:30.388155 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:30.388357 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:30.388224 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:31.399014 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:31.398792 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:31.399399 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:31.399093 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:32.387674 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:32.387639 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:32.387884 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:32.387758 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:32.387884 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:32.387817 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:32.388005 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:32.387953 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:33.388092 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:33.388048 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:33.388496 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:33.388200 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:34.387267 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:34.387233 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:34.387267 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:34.387251 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:34.387524 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:34.387348 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:34.387524 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:34.387498 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:35.390343 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:35.390313 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:35.390744 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:35.390418 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:36.062457 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:36.062411 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:36.062467 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:36.062490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062566 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062586 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062605 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062617 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062634 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:52.062616706 +0000 UTC m=+33.068054520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:36.062672 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062569 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:36.063071 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062661 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:07:52.062650469 +0000 UTC m=+33.068088277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:36.063071 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.062713 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:07:52.062699638 +0000 UTC m=+33.068137454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:36.387996 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:36.387916 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:36.388151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:36.387917 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:36.388151 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.388077 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:36.388256 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:36.388147 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:37.388068 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:37.388034 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:37.388523 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:37.388163 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:38.387462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:38.387431 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:38.387651 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:38.387472 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:38.387651 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:38.387547 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:38.387749 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:38.387671 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:39.388757 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:39.388654 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:39.389335 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:39.388772 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:40.387224 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.387195 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:40.387364 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.387207 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:40.387364 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:40.387314 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:40.387432 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:40.387385 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:40.521598 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.521501 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" event={"ID":"b9d047301ade34e187f662d0538c7f23","Type":"ContainerStarted","Data":"f5e95984b8fcc84ae4536ddd8c23437e0a8edf40f5f0d3d5a51f58001bfe03c4"} Jun 11 23:07:40.523691 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.523629 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lzhsk" event={"ID":"4a4fb35d-0821-4354-9fdf-f91fc3af357d","Type":"ContainerStarted","Data":"875d30cf80e18f24b73b9087a9f65f214589579dd5255cd9f1626eef48c62dc5"} Jun 11 23:07:40.525510 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.525487 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crjk9" event={"ID":"36bb5554-d301-41e0-a6d3-75b051b97d9a","Type":"ContainerStarted","Data":"c4484c45a15fc458b1481b149d97511aeb9f8c84b60914d44d870a0ba1965beb"} Jun 11 23:07:40.535649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.535478 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" podStartSLOduration=20.535465197 podStartE2EDuration="20.535465197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:40.535008211 +0000 UTC m=+21.540446043" watchObservedRunningTime="2026-06-11 23:07:40.535465197 +0000 UTC m=+21.540903027" Jun 11 23:07:40.569163 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.569115 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-crjk9" podStartSLOduration=2.111497123 podStartE2EDuration="21.569099709s" totalImagesPullingTime="19.457602586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:40.55209703 +0000 UTC m=+21.557534860" watchObservedRunningTime="2026-06-11 23:07:40.569099709 +0000 UTC m=+21.574537535" Jun 11 23:07:40.569439 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:40.569262 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lzhsk" podStartSLOduration=2.116472409 podStartE2EDuration="21.569257902s" totalImagesPullingTime="19.452785493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:40.568965784 +0000 UTC m=+21.574403615" watchObservedRunningTime="2026-06-11 23:07:40.569257902 +0000 UTC m=+21.574695733" Jun 11 23:07:41.388207 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.387377 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:41.388207 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:41.387734 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:41.528580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.528393 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" event={"ID":"da859842-bcbc-4668-8a66-5c4332b7c4ce","Type":"ContainerStarted","Data":"67f65f09cd3bc2ee50575d047625c769d3110f570877d18436994a3e017fc623"} Jun 11 23:07:41.529878 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.529853 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w6ztn" event={"ID":"de5c634a-5ae9-4ca7-b9db-0539ef234807","Type":"ContainerStarted","Data":"28955cb5abfca1df64ea9d1f7faf5e1e05e979d37622d5abcd0985dd1cef5285"} Jun 11 23:07:41.531241 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.531218 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerStarted","Data":"75795e84a5ebcc7e404ebfaf3306ee466d10730ef953ac1ebdcf08528bb9f4d8"} Jun 11 23:07:41.533923 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.533906 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:07:41.535965 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.535938 2571 generic.go:356] "Generic (PLEG): container finished" podID="259952ae-371d-4eb0-94bf-f5d5c1c44965" containerID="255f9451959015cb093a7071d498415c9a57a78c13e0263c7149d1bc31971dc9" exitCode=1 Jun 11 23:07:41.536059 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.536023 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"14134157b8fed45f35ce78db62532a462cb84fe19a9d55826166c86e155a5c2f"} Jun 11 23:07:41.536112 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.536075 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"969d175be05afb12159bafc9a9c74f326bed7f0fd1faca60283208af9ba47688"} Jun 11 23:07:41.536160 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.536113 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"a21daf1db0e09c77cc076047ec7a9619b90c65bb18f9c2f57575cfde0eed8cea"} Jun 11 23:07:41.536160 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.536147 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"c63e3f879cd664278afcd138fcad0f52e61e0396c36bc82cd4f910a09ea4110c"} Jun 11 23:07:41.536225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.536184 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerDied","Data":"255f9451959015cb093a7071d498415c9a57a78c13e0263c7149d1bc31971dc9"} Jun 11 23:07:41.536225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.536214 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"3cea7cebe2e1450cd113220c8c56ccbfc865dfde74339f26dab9d466c19a6fd4"} Jun 11 23:07:41.537883 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.537850 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7p8mc" event={"ID":"329364ee-d2da-48a8-8645-06fd73c6cbf9","Type":"ContainerStarted","Data":"34f9c7654b751cf895816538e97c552b810588a772298c22f635bcc62d463204"} Jun 11 23:07:41.539394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.539367 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pzjf7" event={"ID":"b92bb8ca-e3ea-4725-ba46-fa03d6f5db52","Type":"ContainerStarted","Data":"9a7d9653ecf2c7d0c4d424bd5df6c29df6e41d48b9181bd7700d5071fafe71dd"} Jun 11 23:07:41.540855 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.540801 2571 generic.go:356] "Generic (PLEG): container finished" podID="cc6da1b13bca282ef865b3244f5b60b1" containerID="49e4d3d83abbba5df313518beedd774ed1892e165748be34a859cd03c227cd3c" exitCode=0 Jun 11 23:07:41.540968 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.540946 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerDied","Data":"49e4d3d83abbba5df313518beedd774ed1892e165748be34a859cd03c227cd3c"} Jun 11 23:07:41.544436 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.544395 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w6ztn" podStartSLOduration=3.110760256 podStartE2EDuration="22.544377656s" totalImagesPullingTime="19.4336174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:41.544366244 +0000 UTC m=+22.549804118" watchObservedRunningTime="2026-06-11 23:07:41.544377656 +0000 UTC m=+22.549815487" Jun 11 23:07:41.592986 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:41.592915 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7p8mc" podStartSLOduration=7.239130428 podStartE2EDuration="22.592894045s" totalImagesPullingTime="15.353763617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:41.592548429 +0000 UTC m=+22.597986287" watchObservedRunningTime="2026-06-11 23:07:41.592894045 +0000 UTC m=+22.598331876" Jun 11 23:07:42.387750 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.387715 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:42.388032 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.387725 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:42.388032 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:42.387812 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:42.388032 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:42.387941 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:42.541783 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.541752 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 23:07:42.544887 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.544859 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerStarted","Data":"75dba542a9430e5569c31371631b8a5bdd7a8f74920abed8c329ab0e6606a80b"} Jun 11 23:07:42.546475 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.546450 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" event={"ID":"da859842-bcbc-4668-8a66-5c4332b7c4ce","Type":"ContainerStarted","Data":"5b6b8d139d8ec8c7aa764de40059894d22e92cf441397c475c87c1c08869d37b"} Jun 11 23:07:42.547777 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.547755 2571 generic.go:356] "Generic (PLEG): container finished" podID="e15ca259-a328-4d71-8283-b2379cc88c39" containerID="75795e84a5ebcc7e404ebfaf3306ee466d10730ef953ac1ebdcf08528bb9f4d8" exitCode=0 Jun 11 23:07:42.547876 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.547848 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerDied","Data":"75795e84a5ebcc7e404ebfaf3306ee466d10730ef953ac1ebdcf08528bb9f4d8"} Jun 11 23:07:42.549382 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.549279 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jqjh" event={"ID":"6fe74b47-c9ad-43db-8404-1dc50b59ef05","Type":"ContainerStarted","Data":"4e02fec85de4a83349668bf06f0c8aa0a13ea5abf074b7a0c8548aee3fb680bb"} Jun 11 23:07:42.561223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.561182 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" podStartSLOduration=22.561169074 podStartE2EDuration="22.561169074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:42.560748092 +0000 UTC m=+23.566185921" watchObservedRunningTime="2026-06-11 23:07:42.561169074 +0000 UTC m=+23.566606904" Jun 11 23:07:42.561463 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.561438 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pzjf7" podStartSLOduration=4.117110677 podStartE2EDuration="23.561430113s" totalImagesPullingTime="19.444319436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:41.621158858 +0000 UTC m=+22.626596677" watchObservedRunningTime="2026-06-11 23:07:42.561430113 +0000 UTC m=+23.566867943" Jun 11 23:07:42.592511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:42.592454 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5jqjh" podStartSLOduration=4.149549513 podStartE2EDuration="23.592440042s" totalImagesPullingTime="19.442890529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:42.592356726 +0000 UTC m=+23.597794556" watchObservedRunningTime="2026-06-11 23:07:42.592440042 +0000 UTC m=+23.597877873" Jun 11 23:07:43.274900 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:43.274871 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:43.385772 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:43.385684 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:07:42.541779662Z","UUID":"4ecb358d-39b4-470f-933e-59441c760c77","Handler":null,"Name":"","Endpoint":""} Jun 11 23:07:43.387177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:43.387155 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 23:07:43.387307 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:43.387199 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 23:07:43.387307 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:43.387274 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:43.387417 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:43.387386 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:44.388012 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:44.387850 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:44.388372 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:44.387880 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:44.388372 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:44.388090 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:44.388372 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:44.388160 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:44.555622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:44.555582 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" event={"ID":"da859842-bcbc-4668-8a66-5c4332b7c4ce","Type":"ContainerStarted","Data":"c61923e0c74b96c84531195ec39cd8b30fe437100ddd8edff865455343c0bed4"} Jun 11 23:07:44.558553 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:44.558533 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:07:44.558911 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:44.558891 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"19c762d01b9919415dfd523d218c4358389a03cb37852f2e7b2634d11b823876"} Jun 11 23:07:44.572070 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:44.572021 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nt5zb" podStartSLOduration=4.143418767 podStartE2EDuration="25.572005708s" totalImagesPullingTime="21.428586941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:44.571169724 +0000 UTC m=+25.576607574" watchObservedRunningTime="2026-06-11 23:07:44.572005708 +0000 UTC m=+25.577443556" Jun 11 23:07:45.387710 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:45.387670 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:45.387929 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:45.387774 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:46.387949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.387916 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:46.388680 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.387916 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:46.388680 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:46.388052 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:46.388680 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:46.388093 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:46.518486 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.518445 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:46.519085 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.519067 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:46.566727 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.566701 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:07:46.567081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.567059 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"08ea84daad868dd53bff64d5d4daceee58caaa374e678b82ea2d503fecfa53ac"} Jun 11 23:07:46.567552 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.567526 2571 scope.go:117] "RemoveContainer" containerID="255f9451959015cb093a7071d498415c9a57a78c13e0263c7149d1bc31971dc9" Jun 11 23:07:46.567721 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:46.567703 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7p8mc" Jun 11 23:07:47.387388 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.387205 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:47.387547 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:47.387485 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:47.763426 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.763388 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4dj7"] Jun 11 23:07:47.763784 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.763522 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:47.763784 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:47.763613 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:47.766078 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.766032 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gk96x"] Jun 11 23:07:47.766189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.766158 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:47.766289 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:47.766264 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:47.766715 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.766656 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nc9v6"] Jun 11 23:07:47.766805 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:47.766730 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:47.766891 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:47.766815 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:48.575683 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.575662 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:07:48.576005 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.575977 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" event={"ID":"259952ae-371d-4eb0-94bf-f5d5c1c44965","Type":"ContainerStarted","Data":"a12aa0a1fb107c76299c2d219104c31bf2b00f1511584431c680a9457fc3da6e"} Jun 11 23:07:48.576177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.576162 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:48.576260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.576226 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:48.576321 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.576274 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:48.594506 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.594476 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:48.594801 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.594787 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:07:48.608605 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:48.608562 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" podStartSLOduration=9.583352473 podStartE2EDuration="29.60854695s" totalImagesPullingTime="20.025194477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:48.607373939 +0000 UTC m=+29.612811770" watchObservedRunningTime="2026-06-11 23:07:48.60854695 +0000 UTC m=+29.613984771" Jun 11 23:07:49.388455 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:49.388427 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:49.388971 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:49.388525 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:49.388971 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:49.388591 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:49.388971 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:49.388699 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:49.388971 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:49.388727 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:49.388971 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:49.388773 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:49.579698 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:49.579661 2571 generic.go:356] "Generic (PLEG): container finished" podID="e15ca259-a328-4d71-8283-b2379cc88c39" containerID="8a48fb3c2a24e45f3c02c2cdc1ce2b5ed2b16babf5113bd0a8be8383334ebbd2" exitCode=0 Jun 11 23:07:49.579879 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:49.579746 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerDied","Data":"8a48fb3c2a24e45f3c02c2cdc1ce2b5ed2b16babf5113bd0a8be8383334ebbd2"} Jun 11 23:07:50.592699 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:50.592474 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" podUID="259952ae-371d-4eb0-94bf-f5d5c1c44965" containerName="ovnkube-controller" probeResult="failure" output="" Jun 11 23:07:51.388031 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:51.387990 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:51.388031 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:51.388021 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:51.388235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:51.387990 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:51.388235 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:51.388132 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:51.388295 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:51.388245 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:51.388349 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:51.388318 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:51.586481 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:51.586447 2571 generic.go:356] "Generic (PLEG): container finished" podID="e15ca259-a328-4d71-8283-b2379cc88c39" containerID="d175fadef2a998c3c6748095e37de7edfa08ae5cc5ee040aae4e757f133f9f13" exitCode=0 Jun 11 23:07:51.586632 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:51.586503 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerDied","Data":"d175fadef2a998c3c6748095e37de7edfa08ae5cc5ee040aae4e757f133f9f13"} Jun 11 23:07:52.081410 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:52.081363 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:52.081419 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:52.081475 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081523 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081585 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret podName:0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d nodeName:}" failed. No retries permitted until 2026-06-11 23:08:24.081569254 +0000 UTC m=+65.087007063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret") pod "global-pull-secret-syncer-gk96x" (UID: "0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081600 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081617 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081636 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081648 2571 projected.go:196] Error preparing data for projected volume kube-api-access-x8d78 for pod openshift-network-diagnostics/network-check-target-nc9v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081662 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:24.081645022 +0000 UTC m=+65.087082834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:07:52.081858 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:52.081692 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78 podName:16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6 nodeName:}" failed. No retries permitted until 2026-06-11 23:08:24.081676082 +0000 UTC m=+65.087113904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8d78" (UniqueName: "kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78") pod "network-check-target-nc9v6" (UID: "16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:07:52.591583 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:52.591550 2571 generic.go:356] "Generic (PLEG): container finished" podID="e15ca259-a328-4d71-8283-b2379cc88c39" containerID="bbc96db2450fff29492a9cd55a0d9aba070cf51a2a1f4af36de484da287b18e5" exitCode=0 Jun 11 23:07:52.591756 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:52.591600 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerDied","Data":"bbc96db2450fff29492a9cd55a0d9aba070cf51a2a1f4af36de484da287b18e5"} Jun 11 23:07:53.387642 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:53.387607 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:53.388118 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:53.387613 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:53.388118 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:53.387723 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:07:53.388118 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:53.387614 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:53.388118 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:53.387810 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nc9v6" podUID="16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6" Jun 11 23:07:53.388118 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:53.387883 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gk96x" podUID="0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d" Jun 11 23:07:54.341784 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.341709 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeReady" Jun 11 23:07:54.341972 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.341865 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 23:07:54.388209 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.388172 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pgvp6"] Jun 11 23:07:54.392946 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.392923 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pc6c8"] Jun 11 23:07:54.393060 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.393036 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.395416 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.395386 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p6jbq\"" Jun 11 23:07:54.395951 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.395926 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 23:07:54.396135 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.396106 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 23:07:54.396578 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.396553 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.398665 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.398627 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 23:07:54.398995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.398876 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 23:07:54.399191 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.399170 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 23:07:54.399291 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.399190 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rzkf\"" Jun 11 23:07:54.401026 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.400974 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgvp6"] Jun 11 23:07:54.402762 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.402740 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pc6c8"] Jun 11 23:07:54.499246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.499213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d68b326b-ee84-4b8a-8ba0-7ac9b8659708-cert\") pod \"ingress-canary-pc6c8\" (UID: \"d68b326b-ee84-4b8a-8ba0-7ac9b8659708\") " pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.499246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.499254 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjrg\" (UniqueName: \"kubernetes.io/projected/10cc11ea-396d-4ceb-8985-e9e53914cc9f-kube-api-access-qdjrg\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.499479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.499276 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10cc11ea-396d-4ceb-8985-e9e53914cc9f-config-volume\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.499479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.499325 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.499479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.499408 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10cc11ea-396d-4ceb-8985-e9e53914cc9f-tmp-dir\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.499479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.499431 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n95b\" (UniqueName: \"kubernetes.io/projected/d68b326b-ee84-4b8a-8ba0-7ac9b8659708-kube-api-access-6n95b\") pod \"ingress-canary-pc6c8\" (UID: \"d68b326b-ee84-4b8a-8ba0-7ac9b8659708\") " pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.600145 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600066 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10cc11ea-396d-4ceb-8985-e9e53914cc9f-config-volume\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.600145 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600098 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.600324 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:54.600203 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:07:54.600324 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:54.600246 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:07:55.100232958 +0000 UTC m=+36.105670766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:07:54.600324 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600287 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10cc11ea-396d-4ceb-8985-e9e53914cc9f-tmp-dir\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.600324 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600316 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n95b\" (UniqueName: \"kubernetes.io/projected/d68b326b-ee84-4b8a-8ba0-7ac9b8659708-kube-api-access-6n95b\") pod \"ingress-canary-pc6c8\" (UID: \"d68b326b-ee84-4b8a-8ba0-7ac9b8659708\") " pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.600512 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600340 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d68b326b-ee84-4b8a-8ba0-7ac9b8659708-cert\") pod \"ingress-canary-pc6c8\" (UID: \"d68b326b-ee84-4b8a-8ba0-7ac9b8659708\") " pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.600512 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600368 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjrg\" (UniqueName: \"kubernetes.io/projected/10cc11ea-396d-4ceb-8985-e9e53914cc9f-kube-api-access-qdjrg\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.600641 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600622 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10cc11ea-396d-4ceb-8985-e9e53914cc9f-tmp-dir\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.600695 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.600647 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10cc11ea-396d-4ceb-8985-e9e53914cc9f-config-volume\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.604580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.604562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d68b326b-ee84-4b8a-8ba0-7ac9b8659708-cert\") pod \"ingress-canary-pc6c8\" (UID: \"d68b326b-ee84-4b8a-8ba0-7ac9b8659708\") " pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.608188 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.608161 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n95b\" (UniqueName: \"kubernetes.io/projected/d68b326b-ee84-4b8a-8ba0-7ac9b8659708-kube-api-access-6n95b\") pod \"ingress-canary-pc6c8\" (UID: \"d68b326b-ee84-4b8a-8ba0-7ac9b8659708\") " pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.608308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.608260 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjrg\" (UniqueName: \"kubernetes.io/projected/10cc11ea-396d-4ceb-8985-e9e53914cc9f-kube-api-access-qdjrg\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:54.711662 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.711622 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pc6c8" Jun 11 23:07:54.925220 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:54.925036 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pc6c8"] Jun 11 23:07:54.929787 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:07:54.929750 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68b326b_ee84_4b8a_8ba0_7ac9b8659708.slice/crio-6654ef2689a71c7807ce4640f42fd0a1ae2a319396de9fa13d688c775020e8fe WatchSource:0}: Error finding container 6654ef2689a71c7807ce4640f42fd0a1ae2a319396de9fa13d688c775020e8fe: Status 404 returned error can't find the container with id 6654ef2689a71c7807ce4640f42fd0a1ae2a319396de9fa13d688c775020e8fe Jun 11 23:07:55.104763 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.104678 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:55.104948 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:55.104795 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:07:55.104948 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:55.104883 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:07:56.104864789 +0000 UTC m=+37.110302598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:07:55.387978 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.387892 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:07:55.388144 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.387892 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:07:55.388144 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.388043 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:07:55.390659 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.390636 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:07:55.390659 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.390654 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:07:55.391515 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.391403 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hzjk5\"" Jun 11 23:07:55.391515 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.391480 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nchnx\"" Jun 11 23:07:55.391684 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.391517 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:07:55.391684 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.391480 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:07:55.601531 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:55.601411 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pc6c8" event={"ID":"d68b326b-ee84-4b8a-8ba0-7ac9b8659708","Type":"ContainerStarted","Data":"6654ef2689a71c7807ce4640f42fd0a1ae2a319396de9fa13d688c775020e8fe"} Jun 11 23:07:56.111993 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:56.111956 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:56.112186 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:56.112126 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:07:56.112253 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:56.112203 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:07:58.112181637 +0000 UTC m=+39.117619461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:07:58.126593 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:58.126549 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:07:58.127089 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:58.126702 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:07:58.127089 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:07:58.127042 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:08:02.126878382 +0000 UTC m=+43.132316204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:07:58.236861 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:58.236811 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:07:58.372211 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:58.372179 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:07:58.475009 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:58.474983 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:07:58.543342 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:58.543309 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:07:58.893293 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:58.893255 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:07:59.613093 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:59.613052 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pc6c8" event={"ID":"d68b326b-ee84-4b8a-8ba0-7ac9b8659708","Type":"ContainerStarted","Data":"007923b41409dd8e1ffbcc1761a15d19627107a0cc3f9d1a555f6114a0b25c8b"} Jun 11 23:07:59.615772 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:59.615749 2571 generic.go:356] "Generic (PLEG): container finished" podID="e15ca259-a328-4d71-8283-b2379cc88c39" containerID="62f0fddc8016a0b1c53bebba59be80673f68eeffd20982ea89e29da58833be54" exitCode=0 Jun 11 23:07:59.615856 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:59.615797 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerDied","Data":"62f0fddc8016a0b1c53bebba59be80673f68eeffd20982ea89e29da58833be54"} Jun 11 23:07:59.631030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:07:59.630988 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pc6c8" podStartSLOduration=1.7935527150000001 podStartE2EDuration="5.630974068s" totalImagesPullingTime="3.837421353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:07:59.630293296 +0000 UTC m=+40.635731147" watchObservedRunningTime="2026-06-11 23:07:59.630974068 +0000 UTC m=+40.636411933" Jun 11 23:08:00.620577 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:00.620537 2571 generic.go:356] "Generic (PLEG): container finished" podID="e15ca259-a328-4d71-8283-b2379cc88c39" containerID="00d9fec143a816b3fc718bc5558491837eebb366e187d00f29e4bf87c1031ff4" exitCode=0 Jun 11 23:08:00.621038 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:00.620612 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerDied","Data":"00d9fec143a816b3fc718bc5558491837eebb366e187d00f29e4bf87c1031ff4"} Jun 11 23:08:01.626119 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:01.626087 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" event={"ID":"e15ca259-a328-4d71-8283-b2379cc88c39","Type":"ContainerStarted","Data":"63b95bceaf75d20e03a8ab330c1b5eb2282832ae4df2d1977f9214a4c22b5246"} Jun 11 23:08:01.649324 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:01.649273 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ksgm8" podStartSLOduration=9.576454111 podStartE2EDuration="42.649256864s" totalImagesPullingTime="33.072802753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:01.648213212 +0000 UTC m=+42.653651065" watchObservedRunningTime="2026-06-11 23:08:01.649256864 +0000 UTC m=+42.654694695" Jun 11 23:08:01.769568 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:01.769535 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:01.870122 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:01.870086 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:02.158957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:02.158925 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:08:02.159118 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:02.159069 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:02.159164 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:02.159130 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:08:10.159115185 +0000 UTC m=+51.164552997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:08:07.130358 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:07.130323 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:07.221723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:07.221686 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:09.687889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:09.687858 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:09.756459 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:09.756433 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:09.944108 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:09.944025 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:10.009653 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:10.009607 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:10.215180 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:10.215102 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:08:10.215364 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:10.215251 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:10.215364 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:10.215309 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:08:26.215292428 +0000 UTC m=+67.220730245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:08:19.180676 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:19.180637 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:19.236630 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:19.236596 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:20.591307 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:20.591283 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxrrx" Jun 11 23:08:20.739570 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:20.739530 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:20.793097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:20.793055 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:24.115928 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.115871 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:08:24.115928 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.115932 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:08:24.116367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.116049 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:08:24.118532 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.118513 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:08:24.118649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.118628 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:08:24.118731 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.118635 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:08:24.126880 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:24.126860 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:08:24.126930 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:24.126919 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:09:28.12690363 +0000 UTC m=+129.132341438 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : secret "metrics-daemon-secret" not found Jun 11 23:08:24.128937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.128921 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:08:24.130180 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.130161 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d-original-pull-secret\") pod \"global-pull-secret-syncer-gk96x\" (UID: \"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d\") " pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:08:24.139890 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.139864 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8d78\" (UniqueName: \"kubernetes.io/projected/16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6-kube-api-access-x8d78\") pod \"network-check-target-nc9v6\" (UID: \"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6\") " pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:08:24.203271 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.203243 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hzjk5\"" Jun 11 23:08:24.208284 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.208254 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gk96x" Jun 11 23:08:24.211813 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.211776 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:08:24.339642 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.339613 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nc9v6"] Jun 11 23:08:24.343878 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:08:24.343846 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16148ac8_76b4_4fc4_bd19_e7bcaf7d92d6.slice/crio-69de49b2239684dda26a24670ca20a98a795271ee0657d94b38f9d1d83b8f96d WatchSource:0}: Error finding container 69de49b2239684dda26a24670ca20a98a795271ee0657d94b38f9d1d83b8f96d: Status 404 returned error can't find the container with id 69de49b2239684dda26a24670ca20a98a795271ee0657d94b38f9d1d83b8f96d Jun 11 23:08:24.350103 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.350077 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gk96x"] Jun 11 23:08:24.353219 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:08:24.353191 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9b7caa_b272_47ac_bc85_7d4a2d7aca6d.slice/crio-f8a91ab80eea182b543c2ee6aaf8af69bbb655e01425f17d500a5645609497e6 WatchSource:0}: Error finding container f8a91ab80eea182b543c2ee6aaf8af69bbb655e01425f17d500a5645609497e6: Status 404 returned error can't find the container with id f8a91ab80eea182b543c2ee6aaf8af69bbb655e01425f17d500a5645609497e6 Jun 11 23:08:24.681427 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.681392 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gk96x" event={"ID":"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d","Type":"ContainerStarted","Data":"f8a91ab80eea182b543c2ee6aaf8af69bbb655e01425f17d500a5645609497e6"} Jun 11 23:08:24.682367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:24.682347 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nc9v6" event={"ID":"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6","Type":"ContainerStarted","Data":"69de49b2239684dda26a24670ca20a98a795271ee0657d94b38f9d1d83b8f96d"} Jun 11 23:08:26.229564 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:26.229530 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:08:26.229971 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:26.229671 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:26.229971 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:26.229727 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:08:58.229712918 +0000 UTC m=+99.235150726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:08:29.698575 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:29.698525 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gk96x" event={"ID":"0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d","Type":"ContainerStarted","Data":"33ff81a916eb65c03086f7e3fa74ff080027b9c29b2887e3639d400c4dde032a"} Jun 11 23:08:29.700077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:29.700051 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nc9v6" event={"ID":"16148ac8-76b4-4fc4-bd19-e7bcaf7d92d6","Type":"ContainerStarted","Data":"51e8a592633eea7977c53bb97047756e55e70135a43420dec499ee7fc754159a"} Jun 11 23:08:29.700208 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:29.700188 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:08:29.731086 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:29.731027 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nc9v6" podStartSLOduration=66.324985575 podStartE2EDuration="1m10.731009574s" totalImagesPullingTime="4.406023999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:29.730779735 +0000 UTC m=+70.736217582" watchObservedRunningTime="2026-06-11 23:08:29.731009574 +0000 UTC m=+70.736447403" Jun 11 23:08:29.731260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:29.731242 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gk96x" podStartSLOduration=66.329382708 podStartE2EDuration="1m10.731236495s" totalImagesPullingTime="4.401853787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:29.714946824 +0000 UTC m=+70.720384654" watchObservedRunningTime="2026-06-11 23:08:29.731236495 +0000 UTC m=+70.736674325" Jun 11 23:08:30.889809 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:30.889777 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:30.957101 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:30.957061 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:31.361442 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.361407 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6"] Jun 11 23:08:31.393199 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.393165 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.395710 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.395683 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 23:08:31.395857 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.395683 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2l8ng\"" Jun 11 23:08:31.396701 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.396675 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6"] Jun 11 23:08:31.396815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.396728 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 23:08:31.396815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.396740 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 23:08:31.396815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.396745 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 23:08:31.467222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.467181 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfmh\" (UniqueName: \"kubernetes.io/projected/d10eda67-9c1d-480e-99d8-a8c66e721b6f-kube-api-access-nbfmh\") pod \"managed-serviceaccount-addon-agent-5568867d98-t56k6\" (UID: \"d10eda67-9c1d-480e-99d8-a8c66e721b6f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.467395 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.467236 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d10eda67-9c1d-480e-99d8-a8c66e721b6f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5568867d98-t56k6\" (UID: \"d10eda67-9c1d-480e-99d8-a8c66e721b6f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.567780 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.567745 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfmh\" (UniqueName: \"kubernetes.io/projected/d10eda67-9c1d-480e-99d8-a8c66e721b6f-kube-api-access-nbfmh\") pod \"managed-serviceaccount-addon-agent-5568867d98-t56k6\" (UID: \"d10eda67-9c1d-480e-99d8-a8c66e721b6f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.567942 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.567800 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d10eda67-9c1d-480e-99d8-a8c66e721b6f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5568867d98-t56k6\" (UID: \"d10eda67-9c1d-480e-99d8-a8c66e721b6f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.570239 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.570213 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d10eda67-9c1d-480e-99d8-a8c66e721b6f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5568867d98-t56k6\" (UID: \"d10eda67-9c1d-480e-99d8-a8c66e721b6f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.582798 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.582775 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfmh\" (UniqueName: \"kubernetes.io/projected/d10eda67-9c1d-480e-99d8-a8c66e721b6f-kube-api-access-nbfmh\") pod \"managed-serviceaccount-addon-agent-5568867d98-t56k6\" (UID: \"d10eda67-9c1d-480e-99d8-a8c66e721b6f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.710740 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.710663 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" Jun 11 23:08:31.852579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:31.852522 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6"] Jun 11 23:08:31.857012 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:08:31.856985 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd10eda67_9c1d_480e_99d8_a8c66e721b6f.slice/crio-d97cddd7614045f588419cd55a5a510cfb86396a7467c5a48c1685f460ca744f WatchSource:0}: Error finding container d97cddd7614045f588419cd55a5a510cfb86396a7467c5a48c1685f460ca744f: Status 404 returned error can't find the container with id d97cddd7614045f588419cd55a5a510cfb86396a7467c5a48c1685f460ca744f Jun 11 23:08:32.708926 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:32.708883 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" event={"ID":"d10eda67-9c1d-480e-99d8-a8c66e721b6f","Type":"ContainerStarted","Data":"d97cddd7614045f588419cd55a5a510cfb86396a7467c5a48c1685f460ca744f"} Jun 11 23:08:33.485223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:33.485181 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:33.619194 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:33.619159 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:34.716151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:34.716068 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" event={"ID":"d10eda67-9c1d-480e-99d8-a8c66e721b6f","Type":"ContainerStarted","Data":"1e894c8f68372d964c5e98f2b903383721c373a8056a49d15ff5e6e0a41c6433"} Jun 11 23:08:34.732028 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:34.731971 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" podStartSLOduration=1.242822968 podStartE2EDuration="3.731947978s" totalImagesPullingTime="2.48912501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:08:34.73188912 +0000 UTC m=+75.737326950" watchObservedRunningTime="2026-06-11 23:08:34.731947978 +0000 UTC m=+75.737385808" Jun 11 23:08:56.915004 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:56.914974 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:56.970353 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:56.970322 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:08:58.254704 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:08:58.254651 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:08:58.255112 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:58.254804 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:08:58.255112 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:08:58.254885 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:10:02.25487077 +0000 UTC m=+163.260308580 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:09:00.705520 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:09:00.705484 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nc9v6" Jun 11 23:09:04.121369 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:09:04.121322 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:09:28.156044 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:09:28.156006 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:09:28.156462 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:09:28.156114 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:09:28.156462 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:09:28.156167 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs podName:d131b1ac-7e95-40c6-8270-c2e0dad06d82 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:30.156153015 +0000 UTC m=+251.161590823 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs") pod "network-metrics-daemon-x4dj7" (UID: "d131b1ac-7e95-40c6-8270-c2e0dad06d82") : secret "metrics-daemon-secret" not found Jun 11 23:09:57.407618 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:09:57.407574 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pgvp6" podUID="10cc11ea-396d-4ceb-8985-e9e53914cc9f" Jun 11 23:09:57.912960 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:09:57.912930 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgvp6" Jun 11 23:09:58.413882 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:09:58.413839 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x4dj7" podUID="d131b1ac-7e95-40c6-8270-c2e0dad06d82" Jun 11 23:10:02.287783 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:10:02.287737 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:10:02.288207 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:10:02.287916 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:10:02.288207 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:10:02.287984 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls podName:10cc11ea-396d-4ceb-8985-e9e53914cc9f nodeName:}" failed. No retries permitted until 2026-06-11 23:12:04.287967605 +0000 UTC m=+285.293405412 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls") pod "dns-default-pgvp6" (UID: "10cc11ea-396d-4ceb-8985-e9e53914cc9f") : secret "dns-default-metrics-tls" not found Jun 11 23:10:12.387344 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:10:12.387250 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:10:35.003560 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:10:35.003524 2571 generic.go:356] "Generic (PLEG): container finished" podID="d10eda67-9c1d-480e-99d8-a8c66e721b6f" containerID="1e894c8f68372d964c5e98f2b903383721c373a8056a49d15ff5e6e0a41c6433" exitCode=255 Jun 11 23:10:35.003982 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:10:35.003596 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" event={"ID":"d10eda67-9c1d-480e-99d8-a8c66e721b6f","Type":"ContainerDied","Data":"1e894c8f68372d964c5e98f2b903383721c373a8056a49d15ff5e6e0a41c6433"} Jun 11 23:10:35.009226 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:10:35.009207 2571 scope.go:117] "RemoveContainer" containerID="1e894c8f68372d964c5e98f2b903383721c373a8056a49d15ff5e6e0a41c6433" Jun 11 23:10:36.007839 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:10:36.007784 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5568867d98-t56k6" event={"ID":"d10eda67-9c1d-480e-99d8-a8c66e721b6f","Type":"ContainerStarted","Data":"d653873bb1d2ab37f852dfc2404f02aeed59abdfaa4085a15db68f0181c53cc3"} Jun 11 23:11:10.165081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.165044 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69cbd7b74b-cf2pt"] Jun 11 23:11:10.166961 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.166945 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.170511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.169980 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 23:11:10.170511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.170050 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 23:11:10.170511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.170027 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 23:11:10.170511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.169980 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 23:11:10.170511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.170299 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8q9w9\"" Jun 11 23:11:10.170511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.170443 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:11:10.171296 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.171154 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:11:10.189649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.189622 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69cbd7b74b-cf2pt"] Jun 11 23:11:10.253734 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.253698 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-default-certificate\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.253734 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.253732 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.253966 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.253764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjfx\" (UniqueName: \"kubernetes.io/projected/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-kube-api-access-ltjfx\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.253966 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.253841 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-stats-auth\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.253966 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.253859 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.261893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.261865 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4"] Jun 11 23:11:10.263720 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.263704 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-9j85f"] Jun 11 23:11:10.263864 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.263845 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" Jun 11 23:11:10.265243 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.265226 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-lfk9x"] Jun 11 23:11:10.265344 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.265328 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.266219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.266201 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l8gtk\"" Jun 11 23:11:10.266743 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.266729 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65db598dbf-pt9jp"] Jun 11 23:11:10.266872 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.266859 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.267458 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.267437 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 23:11:10.267556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.267501 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 23:11:10.267778 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.267762 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g525x\"" Jun 11 23:11:10.267901 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.267784 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 23:11:10.267959 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.267914 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 23:11:10.268456 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.268441 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.269352 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.269336 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 23:11:10.269660 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.269643 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nthpm\"" Jun 11 23:11:10.269797 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.269666 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 23:11:10.269897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.269686 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 23:11:10.269897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.269732 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:11:10.270651 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.270630 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 23:11:10.270743 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.270633 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bthtv\"" Jun 11 23:11:10.270743 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.270735 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 23:11:10.270968 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.270953 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 23:11:10.277905 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.277882 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4"] Jun 11 23:11:10.279054 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.279036 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-lfk9x"] Jun 11 23:11:10.279769 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.279747 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 23:11:10.281282 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.280277 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-9j85f"] Jun 11 23:11:10.281282 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.281040 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 23:11:10.282344 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.282322 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 23:11:10.282770 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.282751 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65db598dbf-pt9jp"] Jun 11 23:11:10.354678 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354641 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjfx\" (UniqueName: \"kubernetes.io/projected/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-kube-api-access-ltjfx\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.354678 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354677 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-installation-pull-secrets\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354699 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7f7f3f4-eb65-43e1-a505-ded255a53837-trusted-ca\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354721 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85eef17-528e-4e24-be3f-d2306b8f2199-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354780 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7f7f3f4-eb65-43e1-a505-ded255a53837-config\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354812 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5wsn\" (UniqueName: \"kubernetes.io/projected/b7f7f3f4-eb65-43e1-a505-ded255a53837-kube-api-access-t5wsn\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354859 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354901 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d85eef17-528e-4e24-be3f-d2306b8f2199-snapshots\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.354957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354945 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdd233db-350a-420c-86a6-ce0e0894d7b3-ca-trust-extracted\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354966 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d85eef17-528e-4e24-be3f-d2306b8f2199-tmp\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.354983 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f7f3f4-eb65-43e1-a505-ded255a53837-serving-cert\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355037 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56fqs\" (UniqueName: \"kubernetes.io/projected/f2c5ef25-847b-4944-ab59-cb4577246a7d-kube-api-access-56fqs\") pod \"network-check-source-6947749cfc-jd5f4\" (UID: \"f2c5ef25-847b-4944-ab59-cb4577246a7d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355060 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355080 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7prnm\" (UniqueName: \"kubernetes.io/projected/d85eef17-528e-4e24-be3f-d2306b8f2199-kube-api-access-7prnm\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355118 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqb9z\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-kube-api-access-kqb9z\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-image-registry-private-configuration\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.355189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355163 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-trusted-ca\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.355190 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:10.855173649 +0000 UTC m=+231.860611457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : configmap references non-existent config key: service-ca.crt Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-certificates\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355239 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-stats-auth\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.355315 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.355349 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:10.855340657 +0000 UTC m=+231.860778465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : secret "router-metrics-certs-default" not found Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355360 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d85eef17-528e-4e24-be3f-d2306b8f2199-serving-cert\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355380 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-bound-sa-token\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-default-certificate\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.355478 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.355450 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85eef17-528e-4e24-be3f-d2306b8f2199-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.357698 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.357674 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-default-certificate\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.357795 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.357674 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-stats-auth\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.363988 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.363970 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjfx\" (UniqueName: \"kubernetes.io/projected/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-kube-api-access-ltjfx\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.456432 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456334 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-image-registry-private-configuration\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456432 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456374 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-trusted-ca\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456432 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-certificates\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456730 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456509 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d85eef17-528e-4e24-be3f-d2306b8f2199-serving-cert\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.456730 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456635 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-bound-sa-token\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456730 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456685 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85eef17-528e-4e24-be3f-d2306b8f2199-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.456730 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456718 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-installation-pull-secrets\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456746 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7f7f3f4-eb65-43e1-a505-ded255a53837-trusted-ca\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456771 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85eef17-528e-4e24-be3f-d2306b8f2199-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456799 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7f7f3f4-eb65-43e1-a505-ded255a53837-config\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456844 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5wsn\" (UniqueName: \"kubernetes.io/projected/b7f7f3f4-eb65-43e1-a505-ded255a53837-kube-api-access-t5wsn\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456880 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456917 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d85eef17-528e-4e24-be3f-d2306b8f2199-snapshots\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456945 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdd233db-350a-420c-86a6-ce0e0894d7b3-ca-trust-extracted\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.456969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456969 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d85eef17-528e-4e24-be3f-d2306b8f2199-tmp\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.457367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.456997 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f7f3f4-eb65-43e1-a505-ded255a53837-serving-cert\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.457367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457040 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56fqs\" (UniqueName: \"kubernetes.io/projected/f2c5ef25-847b-4944-ab59-cb4577246a7d-kube-api-access-56fqs\") pod \"network-check-source-6947749cfc-jd5f4\" (UID: \"f2c5ef25-847b-4944-ab59-cb4577246a7d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" Jun 11 23:11:10.457367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457111 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7prnm\" (UniqueName: \"kubernetes.io/projected/d85eef17-528e-4e24-be3f-d2306b8f2199-kube-api-access-7prnm\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.457367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457169 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqb9z\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-kube-api-access-kqb9z\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.457367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457204 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-certificates\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.457611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457484 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-trusted-ca\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.457611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457504 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d85eef17-528e-4e24-be3f-d2306b8f2199-tmp\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.457611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457596 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7f7f3f4-eb65-43e1-a505-ded255a53837-config\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.457737 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.457665 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:11:10.457737 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.457684 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65db598dbf-pt9jp: secret "image-registry-tls" not found Jun 11 23:11:10.457856 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.457747 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls podName:fdd233db-350a-420c-86a6-ce0e0894d7b3 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:10.957729015 +0000 UTC m=+231.963166842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls") pod "image-registry-65db598dbf-pt9jp" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3") : secret "image-registry-tls" not found Jun 11 23:11:10.457856 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.457783 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdd233db-350a-420c-86a6-ce0e0894d7b3-ca-trust-extracted\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.458123 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.458063 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d85eef17-528e-4e24-be3f-d2306b8f2199-snapshots\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.458532 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.458511 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85eef17-528e-4e24-be3f-d2306b8f2199-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.458648 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.458629 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85eef17-528e-4e24-be3f-d2306b8f2199-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.458691 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.458648 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7f7f3f4-eb65-43e1-a505-ded255a53837-trusted-ca\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.459525 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.459504 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-image-registry-private-configuration\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.459976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.459949 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f7f3f4-eb65-43e1-a505-ded255a53837-serving-cert\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.460199 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.460173 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-installation-pull-secrets\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.460466 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.460448 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d85eef17-528e-4e24-be3f-d2306b8f2199-serving-cert\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.464241 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.464218 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-bound-sa-token\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.465807 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.465784 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:10.467977 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.467947 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7prnm\" (UniqueName: \"kubernetes.io/projected/d85eef17-528e-4e24-be3f-d2306b8f2199-kube-api-access-7prnm\") pod \"insights-operator-5bbd86d6bd-9j85f\" (UID: \"d85eef17-528e-4e24-be3f-d2306b8f2199\") " pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.468097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.467950 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5wsn\" (UniqueName: \"kubernetes.io/projected/b7f7f3f4-eb65-43e1-a505-ded255a53837-kube-api-access-t5wsn\") pod \"console-operator-5dbbb5d744-lfk9x\" (UID: \"b7f7f3f4-eb65-43e1-a505-ded255a53837\") " pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.468576 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.468554 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56fqs\" (UniqueName: \"kubernetes.io/projected/f2c5ef25-847b-4944-ab59-cb4577246a7d-kube-api-access-56fqs\") pod \"network-check-source-6947749cfc-jd5f4\" (UID: \"f2c5ef25-847b-4944-ab59-cb4577246a7d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" Jun 11 23:11:10.468623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.468554 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqb9z\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-kube-api-access-kqb9z\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.553381 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.553344 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:10.576293 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.576261 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" Jun 11 23:11:10.585186 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.585168 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" Jun 11 23:11:10.591539 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.591512 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:10.728558 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.728395 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4"] Jun 11 23:11:10.730945 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:10.730917 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c5ef25_847b_4944_ab59_cb4577246a7d.slice/crio-8d485dfb8690c15a69e477bf30a2ae78a556b42eb4147d67f5cf7949bf3410ca WatchSource:0}: Error finding container 8d485dfb8690c15a69e477bf30a2ae78a556b42eb4147d67f5cf7949bf3410ca: Status 404 returned error can't find the container with id 8d485dfb8690c15a69e477bf30a2ae78a556b42eb4147d67f5cf7949bf3410ca Jun 11 23:11:10.861502 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.861452 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.861677 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.861618 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:10.861677 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.861635 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:11.861615041 +0000 UTC m=+232.867052871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : configmap references non-existent config key: service-ca.crt Jun 11 23:11:10.861779 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.861764 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:11:10.861860 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.861849 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:11.86181102 +0000 UTC m=+232.867248835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : secret "router-metrics-certs-default" not found Jun 11 23:11:10.944083 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.944048 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-9j85f"] Jun 11 23:11:10.947747 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:10.947677 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85eef17_528e_4e24_be3f_d2306b8f2199.slice/crio-3819080e858216ab0f6a412eaabb12624c024a5aad8280e7e9ad1f0b8c1b1615 WatchSource:0}: Error finding container 3819080e858216ab0f6a412eaabb12624c024a5aad8280e7e9ad1f0b8c1b1615: Status 404 returned error can't find the container with id 3819080e858216ab0f6a412eaabb12624c024a5aad8280e7e9ad1f0b8c1b1615 Jun 11 23:11:10.949457 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.949419 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-lfk9x"] Jun 11 23:11:10.952179 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:10.952152 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f7f3f4_eb65_43e1_a505_ded255a53837.slice/crio-611a6e996ca8134831d2c797b1c9029fe9d322cb7d90884cbeb4c27f5d6facf7 WatchSource:0}: Error finding container 611a6e996ca8134831d2c797b1c9029fe9d322cb7d90884cbeb4c27f5d6facf7: Status 404 returned error can't find the container with id 611a6e996ca8134831d2c797b1c9029fe9d322cb7d90884cbeb4c27f5d6facf7 Jun 11 23:11:10.962868 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:10.962841 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:10.962981 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.962968 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:11:10.963027 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.962985 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65db598dbf-pt9jp: secret "image-registry-tls" not found Jun 11 23:11:10.963060 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:10.963046 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls podName:fdd233db-350a-420c-86a6-ce0e0894d7b3 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:11.963031548 +0000 UTC m=+232.968469356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls") pod "image-registry-65db598dbf-pt9jp" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3") : secret "image-registry-tls" not found Jun 11 23:11:11.110551 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.110449 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" event={"ID":"d85eef17-528e-4e24-be3f-d2306b8f2199","Type":"ContainerStarted","Data":"3819080e858216ab0f6a412eaabb12624c024a5aad8280e7e9ad1f0b8c1b1615"} Jun 11 23:11:11.111847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.111798 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" event={"ID":"f2c5ef25-847b-4944-ab59-cb4577246a7d","Type":"ContainerStarted","Data":"5d345bf4cb4a5905bafb34c2def57d642e00c326a520bde48ba654b28d5973cb"} Jun 11 23:11:11.111982 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.111866 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" event={"ID":"f2c5ef25-847b-4944-ab59-cb4577246a7d","Type":"ContainerStarted","Data":"8d485dfb8690c15a69e477bf30a2ae78a556b42eb4147d67f5cf7949bf3410ca"} Jun 11 23:11:11.112913 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.112876 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" event={"ID":"b7f7f3f4-eb65-43e1-a505-ded255a53837","Type":"ContainerStarted","Data":"611a6e996ca8134831d2c797b1c9029fe9d322cb7d90884cbeb4c27f5d6facf7"} Jun 11 23:11:11.127348 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.127296 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-jd5f4" podStartSLOduration=1.127281785 podStartE2EDuration="1.127281785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:11.125641173 +0000 UTC m=+232.131079004" watchObservedRunningTime="2026-06-11 23:11:11.127281785 +0000 UTC m=+232.132719615" Jun 11 23:11:11.871643 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.871609 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:11.872104 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.871665 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:11.872104 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:11.871783 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:11:11.872104 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:11.871858 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:13.871819762 +0000 UTC m=+234.877257584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : configmap references non-existent config key: service-ca.crt Jun 11 23:11:11.872104 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:11.871891 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:13.871880883 +0000 UTC m=+234.877318713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : secret "router-metrics-certs-default" not found Jun 11 23:11:11.972250 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:11.972211 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:11.972444 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:11.972387 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:11:11.972444 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:11.972406 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65db598dbf-pt9jp: secret "image-registry-tls" not found Jun 11 23:11:11.972548 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:11.972468 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls podName:fdd233db-350a-420c-86a6-ce0e0894d7b3 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:13.972449178 +0000 UTC m=+234.977887020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls") pod "image-registry-65db598dbf-pt9jp" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3") : secret "image-registry-tls" not found Jun 11 23:11:12.541218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:12.541178 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:13.738852 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:13.738802 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:13.887404 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:13.887370 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:13.887598 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:13.887524 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:11:13.887598 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:13.887536 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:13.887598 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:13.887591 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:17.887576048 +0000 UTC m=+238.893013858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : secret "router-metrics-certs-default" not found Jun 11 23:11:13.887759 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:13.887647 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:17.887634794 +0000 UTC m=+238.893072602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : configmap references non-existent config key: service-ca.crt Jun 11 23:11:13.988509 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:13.988471 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:13.988679 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:13.988605 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:11:13.988679 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:13.988624 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65db598dbf-pt9jp: secret "image-registry-tls" not found Jun 11 23:11:13.988679 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:13.988673 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls podName:fdd233db-350a-420c-86a6-ce0e0894d7b3 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:17.988658638 +0000 UTC m=+238.994096461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls") pod "image-registry-65db598dbf-pt9jp" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3") : secret "image-registry-tls" not found Jun 11 23:11:14.050570 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.050478 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.126667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.126635 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" event={"ID":"d85eef17-528e-4e24-be3f-d2306b8f2199","Type":"ContainerStarted","Data":"96aecdb4f2b99fc7690033cc0e3b396889b44b494b102594b0a683a4720035cd"} Jun 11 23:11:14.128197 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.128178 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/0.log" Jun 11 23:11:14.128298 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.128210 2571 generic.go:356] "Generic (PLEG): container finished" podID="b7f7f3f4-eb65-43e1-a505-ded255a53837" containerID="2c91c250f701fc8a8a06c482023fb96a7b3741f8a701930914c3c76599a0f175" exitCode=255 Jun 11 23:11:14.128298 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.128261 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" event={"ID":"b7f7f3f4-eb65-43e1-a505-ded255a53837","Type":"ContainerDied","Data":"2c91c250f701fc8a8a06c482023fb96a7b3741f8a701930914c3c76599a0f175"} Jun 11 23:11:14.128442 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.128429 2571 scope.go:117] "RemoveContainer" containerID="2c91c250f701fc8a8a06c482023fb96a7b3741f8a701930914c3c76599a0f175" Jun 11 23:11:14.142151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.142106 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" podStartSLOduration=1.775664789 podStartE2EDuration="4.142089939s" totalImagesPullingTime="2.36642515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:14.14145167 +0000 UTC m=+235.146889511" watchObservedRunningTime="2026-06-11 23:11:14.142089939 +0000 UTC m=+235.147527769" Jun 11 23:11:14.147808 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.147768 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.303400 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.303315 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.399799 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.399752 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.499859 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.499811 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.551365 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.551333 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.760995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.760964 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:14.858754 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:14.858721 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:15.134206 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.134120 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:11:15.134678 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.134658 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/0.log" Jun 11 23:11:15.134678 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.134701 2571 generic.go:356] "Generic (PLEG): container finished" podID="b7f7f3f4-eb65-43e1-a505-ded255a53837" containerID="5705fc706b18069b43867c5c91139ff780c6988ac2124c9d5d07843130229b87" exitCode=255 Jun 11 23:11:15.134912 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.134773 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" event={"ID":"b7f7f3f4-eb65-43e1-a505-ded255a53837","Type":"ContainerDied","Data":"5705fc706b18069b43867c5c91139ff780c6988ac2124c9d5d07843130229b87"} Jun 11 23:11:15.134912 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.134893 2571 scope.go:117] "RemoveContainer" containerID="2c91c250f701fc8a8a06c482023fb96a7b3741f8a701930914c3c76599a0f175" Jun 11 23:11:15.135622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.135129 2571 scope.go:117] "RemoveContainer" containerID="5705fc706b18069b43867c5c91139ff780c6988ac2124c9d5d07843130229b87" Jun 11 23:11:15.135622 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.135329 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-lfk9x_openshift-console-operator(b7f7f3f4-eb65-43e1-a505-ded255a53837)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" podUID="b7f7f3f4-eb65-43e1-a505-ded255a53837" Jun 11 23:11:15.143654 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.143628 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b9lv6"] Jun 11 23:11:15.146624 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.146603 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.148557 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.148539 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 23:11:15.148644 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.148603 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-87kjf\"" Jun 11 23:11:15.148703 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.148686 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 23:11:15.156966 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.156942 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b9lv6"] Jun 11 23:11:15.175730 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.175696 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:15.237190 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.237149 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:15.301609 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.301575 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.301760 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.301626 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.301895 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.301871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz5f8\" (UniqueName: \"kubernetes.io/projected/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-api-access-qz5f8\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.302066 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.302047 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f148b05-949b-465e-90b4-656e8cc2a6ec-data-volume\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.302131 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.302090 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f148b05-949b-465e-90b4-656e8cc2a6ec-crio-socket\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403269 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403182 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz5f8\" (UniqueName: \"kubernetes.io/projected/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-api-access-qz5f8\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f148b05-949b-465e-90b4-656e8cc2a6ec-data-volume\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403325 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f148b05-949b-465e-90b4-656e8cc2a6ec-crio-socket\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403360 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403388 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403630 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403434 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f148b05-949b-465e-90b4-656e8cc2a6ec-crio-socket\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.403630 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.403444 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:15.403630 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.403480 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:15.403630 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.403520 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:15.903503582 +0000 UTC m=+236.908941410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : configmap "kube-rbac-proxy" not found Jun 11 23:11:15.403630 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.403578 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:15.903563206 +0000 UTC m=+236.909001014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:15.403887 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.403741 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f148b05-949b-465e-90b4-656e8cc2a6ec-data-volume\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.412599 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.412575 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz5f8\" (UniqueName: \"kubernetes.io/projected/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-api-access-qz5f8\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.907201 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.907164 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.907201 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:15.907203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:15.907687 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.907292 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:15.907687 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.907372 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:16.907352493 +0000 UTC m=+237.912790312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : configmap "kube-rbac-proxy" not found Jun 11 23:11:15.907687 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.907390 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:15.907687 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:15.907429 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:16.90741625 +0000 UTC m=+237.912854061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:16.138730 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.138703 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:11:16.139101 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.139084 2571 scope.go:117] "RemoveContainer" containerID="5705fc706b18069b43867c5c91139ff780c6988ac2124c9d5d07843130229b87" Jun 11 23:11:16.139278 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:16.139257 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-lfk9x_openshift-console-operator(b7f7f3f4-eb65-43e1-a505-ded255a53837)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" podUID="b7f7f3f4-eb65-43e1-a505-ded255a53837" Jun 11 23:11:16.402477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.402444 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:16.454132 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.454095 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:16.563846 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.563786 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:16.665439 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.665354 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:16.915202 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.915159 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:16.915604 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:16.915264 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:16.915604 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:16.915309 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:16.915604 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:16.915323 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:16.915604 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:16.915368 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:18.915353002 +0000 UTC m=+239.920790810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:16.915604 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:16.915383 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:18.915377202 +0000 UTC m=+239.920815009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : configmap "kube-rbac-proxy" not found Jun 11 23:11:17.585474 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:17.585436 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:17.924367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:17.924274 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:17.924771 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:17.924398 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:17.924771 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:17.924428 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:11:17.924771 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:17.924495 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:25.924481023 +0000 UTC m=+246.929918831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : secret "router-metrics-certs-default" not found Jun 11 23:11:17.924771 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:17.924539 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle podName:627f4c2a-08eb-4c6a-acc3-a8754010d1bb nodeName:}" failed. No retries permitted until 2026-06-11 23:11:25.924523104 +0000 UTC m=+246.929961130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle") pod "router-default-69cbd7b74b-cf2pt" (UID: "627f4c2a-08eb-4c6a-acc3-a8754010d1bb") : configmap references non-existent config key: service-ca.crt Jun 11 23:11:18.025666 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.025610 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:18.025894 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.025753 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:11:18.025894 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.025770 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65db598dbf-pt9jp: secret "image-registry-tls" not found Jun 11 23:11:18.025894 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.025855 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls podName:fdd233db-350a-420c-86a6-ce0e0894d7b3 nodeName:}" failed. No retries permitted until 2026-06-11 23:11:26.025811049 +0000 UTC m=+247.031248871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls") pod "image-registry-65db598dbf-pt9jp" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3") : secret "image-registry-tls" not found Jun 11 23:11:18.133440 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.133414 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pzjf7_b92bb8ca-e3ea-4725-ba46-fa03d6f5db52/dns-node-resolver/0.log" Jun 11 23:11:18.199002 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.198911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:18.436800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.436763 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:18.578337 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.578300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:18.678180 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.678146 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:18.898753 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.898655 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:18.931677 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.931646 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:18.932077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.931681 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:18.932077 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.931786 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:18.932077 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.931798 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:18.932077 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.931882 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:22.931864247 +0000 UTC m=+243.937302058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:18.932077 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:18.931898 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:22.931891827 +0000 UTC m=+243.937329634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : configmap "kube-rbac-proxy" not found Jun 11 23:11:18.937985 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:18.937965 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w6ztn_de5c634a-5ae9-4ca7-b9db-0539ef234807/node-ca/0.log" Jun 11 23:11:19.535365 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:19.535335 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pc6c8_d68b326b-ee84-4b8a-8ba0-7ac9b8659708/serve-healthcheck-canary/0.log" Jun 11 23:11:19.883974 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:19.883884 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:20.277900 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.277819 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:20.469262 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.469174 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:20.592225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.592194 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:20.592386 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.592247 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:20.592601 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.592589 2571 scope.go:117] "RemoveContainer" containerID="5705fc706b18069b43867c5c91139ff780c6988ac2124c9d5d07843130229b87" Jun 11 23:11:20.592746 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:20.592728 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-lfk9x_openshift-console-operator(b7f7f3f4-eb65-43e1-a505-ded255a53837)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" podUID="b7f7f3f4-eb65-43e1-a505-ded255a53837" Jun 11 23:11:20.672784 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.672755 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:20.873841 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:20.873785 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:21.399460 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:21.399418 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:21.864591 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:21.864556 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:21.965078 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:21.965041 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:22.064742 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.064710 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:22.258897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.258866 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:22.455440 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.455413 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:22.659663 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.659587 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:22.884355 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.884323 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:22.968914 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.968781 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:22.968914 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:22.968846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:22.969132 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:22.968933 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:11:22.969132 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:22.969000 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:11:22.969132 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:22.969015 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:30.968997415 +0000 UTC m=+251.974435226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : configmap "kube-rbac-proxy" not found Jun 11 23:11:22.969132 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:22.969050 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls podName:1f148b05-949b-465e-90b4-656e8cc2a6ec nodeName:}" failed. No retries permitted until 2026-06-11 23:11:30.969034088 +0000 UTC m=+251.974471897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b9lv6" (UID: "1f148b05-949b-465e-90b4-656e8cc2a6ec") : secret "insights-runtime-extractor-tls" not found Jun 11 23:11:23.652376 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:23.652335 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:24.047873 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:24.047808 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:24.450003 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:24.449919 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:24.582762 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:24.582718 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:24.683956 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:24.683923 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:25.243983 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.243947 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:25.653396 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.653310 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:25.855237 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.855206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:25.991913 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.991878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:25.992089 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.991936 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:25.992508 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.992484 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-service-ca-bundle\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:25.994214 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:25.994185 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/627f4c2a-08eb-4c6a-acc3-a8754010d1bb-metrics-certs\") pod \"router-default-69cbd7b74b-cf2pt\" (UID: \"627f4c2a-08eb-4c6a-acc3-a8754010d1bb\") " pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:26.082061 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.082032 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8q9w9\"" Jun 11 23:11:26.090162 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.090136 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:26.092667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.092641 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:26.095131 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.095105 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"image-registry-65db598dbf-pt9jp\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:26.199513 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.199488 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bthtv\"" Jun 11 23:11:26.207601 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.207557 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:26.219723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.219669 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69cbd7b74b-cf2pt"] Jun 11 23:11:26.222865 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:26.222835 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627f4c2a_08eb_4c6a_acc3_a8754010d1bb.slice/crio-6572fedab2b8d7d4662aa299fb86593ac34e7fb3d30172e9cbe29f1b9ac19e3a WatchSource:0}: Error finding container 6572fedab2b8d7d4662aa299fb86593ac34e7fb3d30172e9cbe29f1b9ac19e3a: Status 404 returned error can't find the container with id 6572fedab2b8d7d4662aa299fb86593ac34e7fb3d30172e9cbe29f1b9ac19e3a Jun 11 23:11:26.264960 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.264925 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:26.345853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.345799 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65db598dbf-pt9jp"] Jun 11 23:11:26.348742 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:26.348710 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd233db_350a_420c_86a6_ce0e0894d7b3.slice/crio-78b1c2968b12c4bf34652b4d7d97eaf83923bdf277d5e193e147e7e1a3371881 WatchSource:0}: Error finding container 78b1c2968b12c4bf34652b4d7d97eaf83923bdf277d5e193e147e7e1a3371881: Status 404 returned error can't find the container with id 78b1c2968b12c4bf34652b4d7d97eaf83923bdf277d5e193e147e7e1a3371881 Jun 11 23:11:26.851969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:26.851935 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:27.174030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.173932 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" event={"ID":"fdd233db-350a-420c-86a6-ce0e0894d7b3","Type":"ContainerStarted","Data":"e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81"} Jun 11 23:11:27.174434 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.174095 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:11:27.174434 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.174148 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" event={"ID":"fdd233db-350a-420c-86a6-ce0e0894d7b3","Type":"ContainerStarted","Data":"78b1c2968b12c4bf34652b4d7d97eaf83923bdf277d5e193e147e7e1a3371881"} Jun 11 23:11:27.175407 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.175385 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" event={"ID":"627f4c2a-08eb-4c6a-acc3-a8754010d1bb","Type":"ContainerStarted","Data":"ef9ace4e0f4564729dc97cede791b372dc8538fa0f1181aeadd7751c670692fb"} Jun 11 23:11:27.175471 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.175425 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" event={"ID":"627f4c2a-08eb-4c6a-acc3-a8754010d1bb","Type":"ContainerStarted","Data":"6572fedab2b8d7d4662aa299fb86593ac34e7fb3d30172e9cbe29f1b9ac19e3a"} Jun 11 23:11:27.194185 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.194135 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" podStartSLOduration=17.194118327 podStartE2EDuration="17.194118327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:27.192367204 +0000 UTC m=+248.197805059" watchObservedRunningTime="2026-06-11 23:11:27.194118327 +0000 UTC m=+248.199556157" Jun 11 23:11:27.212220 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.212173 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" podStartSLOduration=17.212155527 podStartE2EDuration="17.212155527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:27.210974136 +0000 UTC m=+248.216411982" watchObservedRunningTime="2026-06-11 23:11:27.212155527 +0000 UTC m=+248.217593359" Jun 11 23:11:27.378418 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.378380 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:27.481787 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.481754 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:27.658903 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:27.658863 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:28.057108 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.057057 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:28.090303 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.090259 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:28.092883 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.092859 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:28.178583 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.178552 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:28.179864 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.179816 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69cbd7b74b-cf2pt" Jun 11 23:11:28.256371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.256330 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:28.462426 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.462333 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:28.653723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.653678 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:28.852390 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.852358 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:28.972493 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:28.972455 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:29.072755 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:29.072722 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:29.173275 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:29.173186 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:29.273997 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:29.273958 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:30.230204 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:30.230159 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:11:30.232566 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:30.232538 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d131b1ac-7e95-40c6-8270-c2e0dad06d82-metrics-certs\") pod \"network-metrics-daemon-x4dj7\" (UID: \"d131b1ac-7e95-40c6-8270-c2e0dad06d82\") " pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:11:30.390577 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:30.390543 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nchnx\"" Jun 11 23:11:30.398519 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:30.398500 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4dj7" Jun 11 23:11:30.523882 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:30.523783 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4dj7"] Jun 11 23:11:30.527679 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:30.527656 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd131b1ac_7e95_40c6_8270_c2e0dad06d82.slice/crio-9abf7089c07c1e825f8e0517027e3e8df850549c45c8d431365429c54433b5b4 WatchSource:0}: Error finding container 9abf7089c07c1e825f8e0517027e3e8df850549c45c8d431365429c54433b5b4: Status 404 returned error can't find the container with id 9abf7089c07c1e825f8e0517027e3e8df850549c45c8d431365429c54433b5b4 Jun 11 23:11:31.035804 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.035766 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:31.036015 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.035810 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:31.036370 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.036346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f148b05-949b-465e-90b4-656e8cc2a6ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:31.038221 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.038199 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f148b05-949b-465e-90b4-656e8cc2a6ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9lv6\" (UID: \"1f148b05-949b-465e-90b4-656e8cc2a6ec\") " pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:31.058977 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.058940 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-87kjf\"" Jun 11 23:11:31.066217 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.066189 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b9lv6" Jun 11 23:11:31.189987 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.189912 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4dj7" event={"ID":"d131b1ac-7e95-40c6-8270-c2e0dad06d82","Type":"ContainerStarted","Data":"9abf7089c07c1e825f8e0517027e3e8df850549c45c8d431365429c54433b5b4"} Jun 11 23:11:31.225709 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:31.225673 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b9lv6"] Jun 11 23:11:31.228692 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:31.228660 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f148b05_949b_465e_90b4_656e8cc2a6ec.slice/crio-b6c9011e645b0bdcf997712001829b4c17159bd631c0a5c6043b41bcd5b6bc0e WatchSource:0}: Error finding container b6c9011e645b0bdcf997712001829b4c17159bd631c0a5c6043b41bcd5b6bc0e: Status 404 returned error can't find the container with id b6c9011e645b0bdcf997712001829b4c17159bd631c0a5c6043b41bcd5b6bc0e Jun 11 23:11:32.195712 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:32.195674 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9lv6" event={"ID":"1f148b05-949b-465e-90b4-656e8cc2a6ec","Type":"ContainerStarted","Data":"b6c9011e645b0bdcf997712001829b4c17159bd631c0a5c6043b41bcd5b6bc0e"} Jun 11 23:11:32.197879 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:32.197848 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4dj7" event={"ID":"d131b1ac-7e95-40c6-8270-c2e0dad06d82","Type":"ContainerStarted","Data":"6da4a29f4b647810b479884dab37801e48bc2b854571598901629905b8e1dcb4"} Jun 11 23:11:32.198016 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:32.197904 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4dj7" event={"ID":"d131b1ac-7e95-40c6-8270-c2e0dad06d82","Type":"ContainerStarted","Data":"b44a0c3d515c1d99fa6d246f9e7eb838d501c0d2c7412b1434e462daead7ab18"} Jun 11 23:11:32.216193 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:32.216136 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x4dj7" podStartSLOduration=252.181259502 podStartE2EDuration="4m13.216119446s" totalImagesPullingTime="1.034859944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:32.215230378 +0000 UTC m=+253.220668212" watchObservedRunningTime="2026-06-11 23:11:32.216119446 +0000 UTC m=+253.221557305" Jun 11 23:11:35.211732 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:35.211697 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9lv6" event={"ID":"1f148b05-949b-465e-90b4-656e8cc2a6ec","Type":"ContainerStarted","Data":"1eb63aed5b1461fa3dd66366f0168ce453ee4870f2ee2cf3b7810440baff28b1"} Jun 11 23:11:36.217791 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.217753 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9lv6" event={"ID":"1f148b05-949b-465e-90b4-656e8cc2a6ec","Type":"ContainerStarted","Data":"f862ca0e7c2e8beca6140c813873fe7990bb1a40b3b288c190bd60e2ddc60437"} Jun 11 23:11:36.387735 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.387699 2571 scope.go:117] "RemoveContainer" containerID="5705fc706b18069b43867c5c91139ff780c6988ac2124c9d5d07843130229b87" Jun 11 23:11:36.556254 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.556219 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z"] Jun 11 23:11:36.564083 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.564056 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:36.567207 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.567176 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kn9qj\"" Jun 11 23:11:36.567338 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.567278 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 23:11:36.568670 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.568643 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z"] Jun 11 23:11:36.573008 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.572770 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65db598dbf-pt9jp"] Jun 11 23:11:36.578795 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.578719 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d5f56ad3-28bd-472a-aa3f-7bd4161304c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-xml8z\" (UID: \"d5f56ad3-28bd-472a-aa3f-7bd4161304c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:36.653305 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.653254 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:36.679835 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.679783 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d5f56ad3-28bd-472a-aa3f-7bd4161304c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-xml8z\" (UID: \"d5f56ad3-28bd-472a-aa3f-7bd4161304c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:36.682400 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.682378 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d5f56ad3-28bd-472a-aa3f-7bd4161304c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-xml8z\" (UID: \"d5f56ad3-28bd-472a-aa3f-7bd4161304c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:36.742796 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.742764 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:36.876240 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:36.876210 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:37.032503 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.032473 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z"] Jun 11 23:11:37.035659 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:37.035631 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f56ad3_28bd_472a_aa3f_7bd4161304c9.slice/crio-1c00bc394a8c8651cec2c3f06969b91ba42f42d80e89d3207ea31b2e18d8a0b6 WatchSource:0}: Error finding container 1c00bc394a8c8651cec2c3f06969b91ba42f42d80e89d3207ea31b2e18d8a0b6: Status 404 returned error can't find the container with id 1c00bc394a8c8651cec2c3f06969b91ba42f42d80e89d3207ea31b2e18d8a0b6 Jun 11 23:11:37.077580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.077500 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:37.181622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.181577 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:37.223047 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.223011 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" event={"ID":"d5f56ad3-28bd-472a-aa3f-7bd4161304c9","Type":"ContainerStarted","Data":"1c00bc394a8c8651cec2c3f06969b91ba42f42d80e89d3207ea31b2e18d8a0b6"} Jun 11 23:11:37.224819 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.224800 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:11:37.224955 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.224927 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" event={"ID":"b7f7f3f4-eb65-43e1-a505-ded255a53837","Type":"ContainerStarted","Data":"7f4a864b2a03cacd2e3ba4c79e7f48d56040fa2f9bef3e3814150b52abe03748"} Jun 11 23:11:37.225211 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.225188 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:37.227073 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.227053 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9lv6" event={"ID":"1f148b05-949b-465e-90b4-656e8cc2a6ec","Type":"ContainerStarted","Data":"414a1c68c2de6978124fd436d788674fe3dc1aa37751b7440acc4098c5a3287f"} Jun 11 23:11:37.242489 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.242437 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" podStartSLOduration=24.881898954 podStartE2EDuration="27.242424459s" totalImagesPullingTime="2.360525505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:37.241581026 +0000 UTC m=+258.247018882" watchObservedRunningTime="2026-06-11 23:11:37.242424459 +0000 UTC m=+258.247862289" Jun 11 23:11:37.258155 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.258097 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b9lv6" podStartSLOduration=16.839848435 podStartE2EDuration="22.258079341s" totalImagesPullingTime="5.418230906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:37.257444072 +0000 UTC m=+258.262881900" watchObservedRunningTime="2026-06-11 23:11:37.258079341 +0000 UTC m=+258.263517173" Jun 11 23:11:37.561691 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.561662 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-lfk9x" Jun 11 23:11:37.752702 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.752666 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-5c8jv"] Jun 11 23:11:37.756337 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.756310 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:37.756836 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.756796 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:37.758719 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.758668 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-psnhz\"" Jun 11 23:11:37.759168 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.758976 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 23:11:37.759608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.759542 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 23:11:37.765655 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.765626 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-5c8jv"] Jun 11 23:11:37.791974 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.791905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2jgv\" (UniqueName: \"kubernetes.io/projected/df802e6c-a79a-48b9-bd56-236b0d6de8a8-kube-api-access-k2jgv\") pod \"downloads-694c955b9-5c8jv\" (UID: \"df802e6c-a79a-48b9-bd56-236b0d6de8a8\") " pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:37.855225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.855139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:37.892883 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.892842 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2jgv\" (UniqueName: \"kubernetes.io/projected/df802e6c-a79a-48b9-bd56-236b0d6de8a8-kube-api-access-k2jgv\") pod \"downloads-694c955b9-5c8jv\" (UID: \"df802e6c-a79a-48b9-bd56-236b0d6de8a8\") " pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:37.901012 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.900977 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2jgv\" (UniqueName: \"kubernetes.io/projected/df802e6c-a79a-48b9-bd56-236b0d6de8a8-kube-api-access-k2jgv\") pod \"downloads-694c955b9-5c8jv\" (UID: \"df802e6c-a79a-48b9-bd56-236b0d6de8a8\") " pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:37.918608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:37.918567 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:38.049801 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.049727 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:38.068551 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.068519 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:38.211930 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.211891 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-5c8jv"] Jun 11 23:11:38.214701 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:38.214675 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf802e6c_a79a_48b9_bd56_236b0d6de8a8.slice/crio-3a5208250e00ea65db07651dc405f3435c8d72d9f004d8c34ad88263cd70a26b WatchSource:0}: Error finding container 3a5208250e00ea65db07651dc405f3435c8d72d9f004d8c34ad88263cd70a26b: Status 404 returned error can't find the container with id 3a5208250e00ea65db07651dc405f3435c8d72d9f004d8c34ad88263cd70a26b Jun 11 23:11:38.232172 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.232142 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" event={"ID":"d5f56ad3-28bd-472a-aa3f-7bd4161304c9","Type":"ContainerStarted","Data":"de4c19d8e5c179a1b8ac195069e443e997cc7bf6de13701a1cc651d19ef1b671"} Jun 11 23:11:38.232568 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.232341 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:38.233464 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.233422 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-5c8jv" event={"ID":"df802e6c-a79a-48b9-bd56-236b0d6de8a8","Type":"ContainerStarted","Data":"3a5208250e00ea65db07651dc405f3435c8d72d9f004d8c34ad88263cd70a26b"} Jun 11 23:11:38.237123 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.237104 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" Jun 11 23:11:38.260057 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.260007 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xml8z" podStartSLOduration=1.213555751 podStartE2EDuration="2.25999162s" totalImagesPullingTime="1.046435869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:38.259674473 +0000 UTC m=+259.265112293" watchObservedRunningTime="2026-06-11 23:11:38.25999162 +0000 UTC m=+259.265429452" Jun 11 23:11:38.418027 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.417934 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:38.504744 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.504711 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:38.881745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:38.881713 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.009654 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.009619 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.102238 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.102205 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.203974 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.203881 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.283216 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.283178 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.441740 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.441697 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.509093 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.509054 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:39.591748 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:39.591709 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:41.047782 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:41.047744 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:41.147993 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:41.147957 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:41.248429 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:41.248394 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:43.303428 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.303386 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:43.500632 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.500598 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:43.612447 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.612364 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:43.745851 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.745800 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-pn64n"] Jun 11 23:11:43.750681 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.750658 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.768811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.768779 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 23:11:43.774839 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.774797 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 23:11:43.774981 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.774797 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 23:11:43.775778 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.775747 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 23:11:43.775910 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.775791 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 23:11:43.775976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.775934 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hrczw\"" Jun 11 23:11:43.777303 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.777278 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-pn64n"] Jun 11 23:11:43.785369 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.785345 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 23:11:43.791700 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.791672 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:43.821950 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.821911 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxp96"] Jun 11 23:11:43.828893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.828862 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.834869 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.834815 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 23:11:43.835005 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.834869 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 23:11:43.836400 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.836329 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ctfkv\"" Jun 11 23:11:43.845921 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.845891 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4a35ff33-4d54-468c-8636-5cd0269c136e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.845921 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.845895 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 23:11:43.846113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.845943 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.846113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.846020 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.846113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.846074 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mgr\" (UniqueName: \"kubernetes.io/projected/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-api-access-87mgr\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.846234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.846124 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a35ff33-4d54-468c-8636-5cd0269c136e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.846234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.846157 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.947265 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947180 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-textfile\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947265 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947241 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.947461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947270 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-sys\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947374 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mgr\" (UniqueName: \"kubernetes.io/projected/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-api-access-87mgr\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.947461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947400 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a35ff33-4d54-468c-8636-5cd0269c136e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.947461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947425 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-metrics-client-ca\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947453 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.947714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947583 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-wtmp\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947632 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947664 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4a35ff33-4d54-468c-8636-5cd0269c136e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.947714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947684 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-root\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.947714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947710 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.948035 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947732 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khhph\" (UniqueName: \"kubernetes.io/projected/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-kube-api-access-khhph\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.948035 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.947764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-tls\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:43.948035 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:43.947897 2571 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 23:11:43.948035 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:11:43.947978 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-tls podName:4a35ff33-4d54-468c-8636-5cd0269c136e nodeName:}" failed. No retries permitted until 2026-06-11 23:11:44.447958633 +0000 UTC m=+265.453396442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-pn64n" (UID: "4a35ff33-4d54-468c-8636-5cd0269c136e") : secret "kube-state-metrics-tls" not found Jun 11 23:11:43.948224 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.948070 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.948224 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.948107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4a35ff33-4d54-468c-8636-5cd0269c136e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.948224 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.948119 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a35ff33-4d54-468c-8636-5cd0269c136e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.950244 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.950219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:43.969351 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:43.969324 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mgr\" (UniqueName: \"kubernetes.io/projected/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-api-access-87mgr\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:44.048181 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-tls\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048366 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048198 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-textfile\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048366 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048324 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-sys\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048468 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048386 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-metrics-client-ca\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048468 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048381 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-sys\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048468 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048504 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-wtmp\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048561 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048569 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-textfile\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048589 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-root\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048771 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048649 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-root\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048771 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048717 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-wtmp\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.048771 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.048719 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khhph\" (UniqueName: \"kubernetes.io/projected/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-kube-api-access-khhph\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.049327 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.049304 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-metrics-client-ca\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.049523 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.049498 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.049888 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.049818 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.051972 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.051944 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.052112 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.052090 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-node-exporter-tls\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.061112 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.061088 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khhph\" (UniqueName: \"kubernetes.io/projected/b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c-kube-api-access-khhph\") pod \"node-exporter-bxp96\" (UID: \"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c\") " pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.140431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.140396 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxp96" Jun 11 23:11:44.144512 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.144469 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.153254 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:44.153212 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8351eaf_aa3b_4b0e_bab8_3b1c9d31c47c.slice/crio-3e32d53d251ddafe2c072e7691879b39425103505da589203b83fc1851dc0cc6 WatchSource:0}: Error finding container 3e32d53d251ddafe2c072e7691879b39425103505da589203b83fc1851dc0cc6: Status 404 returned error can't find the container with id 3e32d53d251ddafe2c072e7691879b39425103505da589203b83fc1851dc0cc6 Jun 11 23:11:44.247655 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.247614 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.259935 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.259904 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxp96" event={"ID":"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c","Type":"ContainerStarted","Data":"3e32d53d251ddafe2c072e7691879b39425103505da589203b83fc1851dc0cc6"} Jun 11 23:11:44.348054 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.348018 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.453018 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.452975 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:44.456287 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.456258 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a35ff33-4d54-468c-8636-5cd0269c136e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-pn64n\" (UID: \"4a35ff33-4d54-468c-8636-5cd0269c136e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:44.549113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.548918 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.650269 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.650232 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.662445 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.662369 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" Jun 11 23:11:44.662848 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.662809 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:11:44.666786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.666763 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670094 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670231 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dc628\"" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670303 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670454 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670518 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670631 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 23:11:44.670776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670684 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 23:11:44.671193 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.670903 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 23:11:44.671744 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.671575 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 23:11:44.672152 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.671991 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 23:11:44.688187 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.688157 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:11:44.756200 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756167 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756227 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756264 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-web-config\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756284 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756310 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756364 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756647 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756394 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756647 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756490 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756647 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756547 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756647 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756577 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756647 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756605 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jqx\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-kube-api-access-p2jqx\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756927 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756657 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.756927 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.756683 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-out\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.786398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.786325 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.835108 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.835053 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-pn64n"] Jun 11 23:11:44.857515 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857481 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.857675 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857525 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-web-config\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.857675 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857550 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.857811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857791 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.857893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.857942 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857913 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.857997 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.857969 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.858053 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858012 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.858053 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858037 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.858148 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858064 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jqx\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-kube-api-access-p2jqx\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.858148 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858119 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.858243 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858146 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-out\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.858243 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858196 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.859788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858801 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.859788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.858877 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.859788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.859467 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.861109 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.861063 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.861345 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.861318 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.861538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.861512 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.862932 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.862907 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.863554 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.863500 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.863653 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.863612 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.863718 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.863670 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-web-config\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.864163 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.864140 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.864965 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.864933 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-out\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.871725 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.871702 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jqx\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-kube-api-access-p2jqx\") pod \"alertmanager-main-0\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:44.873190 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.873164 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.969569 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.969531 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:44.970018 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:44.969985 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a35ff33_4d54_468c_8636_5cd0269c136e.slice/crio-1016c59ee6db90303684d1d8775148d4a9009304d7fbcd3b34be06b141b41d3b WatchSource:0}: Error finding container 1016c59ee6db90303684d1d8775148d4a9009304d7fbcd3b34be06b141b41d3b: Status 404 returned error can't find the container with id 1016c59ee6db90303684d1d8775148d4a9009304d7fbcd3b34be06b141b41d3b Jun 11 23:11:44.982502 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:44.982479 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:11:45.172247 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:45.172200 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:11:45.174374 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:45.174342 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1fc4a2_dcda_4586_9699_5037c4df1cfb.slice/crio-bfcd5b7ee1a32567d0554b0833c4f326ce2b013d6ef4ade6f6543a648d33da77 WatchSource:0}: Error finding container bfcd5b7ee1a32567d0554b0833c4f326ce2b013d6ef4ade6f6543a648d33da77: Status 404 returned error can't find the container with id bfcd5b7ee1a32567d0554b0833c4f326ce2b013d6ef4ade6f6543a648d33da77 Jun 11 23:11:45.266091 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:45.266046 2571 generic.go:356] "Generic (PLEG): container finished" podID="b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c" containerID="558520e25316b9707fc542d24dab465bbdf35ff671aa3b14149f7d2d5fedfb80" exitCode=0 Jun 11 23:11:45.266245 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:45.266110 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxp96" event={"ID":"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c","Type":"ContainerDied","Data":"558520e25316b9707fc542d24dab465bbdf35ff671aa3b14149f7d2d5fedfb80"} Jun 11 23:11:45.267773 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:45.267744 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"bfcd5b7ee1a32567d0554b0833c4f326ce2b013d6ef4ade6f6543a648d33da77"} Jun 11 23:11:45.269190 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:45.269160 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" event={"ID":"4a35ff33-4d54-468c-8636-5cd0269c136e","Type":"ContainerStarted","Data":"1016c59ee6db90303684d1d8775148d4a9009304d7fbcd3b34be06b141b41d3b"} Jun 11 23:11:46.278073 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.278033 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxp96" event={"ID":"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c","Type":"ContainerStarted","Data":"7db059e564c32562c666ed832de682012db21c7e03d313d47d1b3c98558b2f6b"} Jun 11 23:11:46.278567 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.278133 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxp96" event={"ID":"b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c","Type":"ContainerStarted","Data":"0de10f104c9c0751680bb62a1ba6f643bfb07ccd0aa7e6da3eebaf5449a95737"} Jun 11 23:11:46.301898 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.301784 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxp96" podStartSLOduration=2.354897242 podStartE2EDuration="3.301762379s" totalImagesPullingTime="864.488903ms" totalInitContainerRuntime="82.376234ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:46.301713979 +0000 UTC m=+267.307151810" watchObservedRunningTime="2026-06-11 23:11:46.301762379 +0000 UTC m=+267.307200210" Jun 11 23:11:46.521913 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.521808 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:46.580286 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.580257 2571 patch_prober.go:28] interesting pod/image-registry-65db598dbf-pt9jp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:11:46.580387 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.580307 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:11:46.637123 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.637070 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:46.708145 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.708103 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66fb789b57-zd25w"] Jun 11 23:11:46.714135 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.714028 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.717671 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.717419 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kp5bf\"" Jun 11 23:11:46.717671 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.717558 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 23:11:46.717889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.717731 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 23:11:46.717889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.717791 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 23:11:46.717889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.717732 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 23:11:46.717889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.717794 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a210c3dg1v4ia\"" Jun 11 23:11:46.718152 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.718131 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 23:11:46.733800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.733707 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fb789b57-zd25w"] Jun 11 23:11:46.773653 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.773610 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:46.777074 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777035 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qpk6\" (UniqueName: \"kubernetes.io/projected/d33727a0-9433-4ba6-87f1-be1223cbfd21-kube-api-access-6qpk6\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777091 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-grpc-tls\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777125 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777168 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777382 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777238 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33727a0-9433-4ba6-87f1-be1223cbfd21-metrics-client-ca\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777382 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777284 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777382 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777319 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-tls\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.777382 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.777369 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.878340 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878211 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.878340 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878268 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-tls\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.878340 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878321 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.879030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878354 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qpk6\" (UniqueName: \"kubernetes.io/projected/d33727a0-9433-4ba6-87f1-be1223cbfd21-kube-api-access-6qpk6\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.879030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878390 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-grpc-tls\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.879030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878418 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.879030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.879030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.878520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33727a0-9433-4ba6-87f1-be1223cbfd21-metrics-client-ca\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.879944 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.879284 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33727a0-9433-4ba6-87f1-be1223cbfd21-metrics-client-ca\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.881945 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.881878 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-tls\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.882039 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.881951 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.882117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.882076 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.882230 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.882208 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.883022 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.882982 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.883144 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.883107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d33727a0-9433-4ba6-87f1-be1223cbfd21-secret-grpc-tls\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.889084 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.889060 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qpk6\" (UniqueName: \"kubernetes.io/projected/d33727a0-9433-4ba6-87f1-be1223cbfd21-kube-api-access-6qpk6\") pod \"thanos-querier-66fb789b57-zd25w\" (UID: \"d33727a0-9433-4ba6-87f1-be1223cbfd21\") " pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:46.893788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:46.893753 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:47.028333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.028279 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:11:47.202550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.202505 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fb789b57-zd25w"] Jun 11 23:11:47.205851 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:47.205797 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33727a0_9433_4ba6_87f1_be1223cbfd21.slice/crio-7fea6d65721b468ac49966947fbe20b086fa35af5b168fb12a7101fe091147cb WatchSource:0}: Error finding container 7fea6d65721b468ac49966947fbe20b086fa35af5b168fb12a7101fe091147cb: Status 404 returned error can't find the container with id 7fea6d65721b468ac49966947fbe20b086fa35af5b168fb12a7101fe091147cb Jun 11 23:11:47.285080 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.285021 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" event={"ID":"4a35ff33-4d54-468c-8636-5cd0269c136e","Type":"ContainerStarted","Data":"494f28f486d98e6ae4d4ffef9f3c4599bcb1b53240cdceee43a1aae3a31c43a1"} Jun 11 23:11:47.285536 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.285203 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" event={"ID":"4a35ff33-4d54-468c-8636-5cd0269c136e","Type":"ContainerStarted","Data":"d44b31c40337967c72b579dca389689ca64f7ba11679a60d53e363fd7a178ba0"} Jun 11 23:11:47.285536 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.285248 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" event={"ID":"4a35ff33-4d54-468c-8636-5cd0269c136e","Type":"ContainerStarted","Data":"836ecf1227b06c297d1a8886c38abfe5d9654b610958b501f918198139d843c2"} Jun 11 23:11:47.286476 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.286446 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"7fea6d65721b468ac49966947fbe20b086fa35af5b168fb12a7101fe091147cb"} Jun 11 23:11:47.288267 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.288239 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3" exitCode=0 Jun 11 23:11:47.288365 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.288240 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3"} Jun 11 23:11:47.307011 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:47.306960 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-pn64n" podStartSLOduration=2.8163311589999998 podStartE2EDuration="4.306937338s" totalImagesPullingTime="1.490606179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:47.305927009 +0000 UTC m=+268.311364864" watchObservedRunningTime="2026-06-11 23:11:47.306937338 +0000 UTC m=+268.312375149" Jun 11 23:11:48.218366 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.218323 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58dcf9444f-k472h"] Jun 11 23:11:48.222920 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.222894 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.225326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.225297 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 23:11:48.225466 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.225369 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5vhc4\"" Jun 11 23:11:48.225466 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.225386 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 23:11:48.225736 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.225719 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 23:11:48.226360 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.226304 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aje30mqvlr1k7\"" Jun 11 23:11:48.226474 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.226377 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 23:11:48.232804 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.232742 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58dcf9444f-k472h"] Jun 11 23:11:48.291840 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.291782 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40c7d88b-5a53-471b-a758-d00925bc42d3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.292256 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.291877 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-secret-metrics-server-tls\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.292256 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.291919 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/40c7d88b-5a53-471b-a758-d00925bc42d3-audit-log\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.292256 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.292028 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-client-ca-bundle\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.292256 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.292053 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-secret-metrics-server-client-certs\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.292256 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.292089 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvd8\" (UniqueName: \"kubernetes.io/projected/40c7d88b-5a53-471b-a758-d00925bc42d3-kube-api-access-dxvd8\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.292256 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.292183 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/40c7d88b-5a53-471b-a758-d00925bc42d3-metrics-server-audit-profiles\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.334367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.334321 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:48.342061 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.342030 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-r82vn"] Jun 11 23:11:48.345327 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.345302 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.348216 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.348190 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7w7w8\"" Jun 11 23:11:48.348436 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.348398 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 23:11:48.355573 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.355516 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-r82vn"] Jun 11 23:11:48.393341 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393306 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-client-ca-bundle\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.393538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393353 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-secret-metrics-server-client-certs\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.393630 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393594 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwkcw\" (UniqueName: \"kubernetes.io/projected/86055f0e-dbab-4bf9-9578-b890b420db84-kube-api-access-wwkcw\") pod \"monitoring-plugin-589576dfc7-r82vn\" (UID: \"86055f0e-dbab-4bf9-9578-b890b420db84\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.393695 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393648 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvd8\" (UniqueName: \"kubernetes.io/projected/40c7d88b-5a53-471b-a758-d00925bc42d3-kube-api-access-dxvd8\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.393743 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393698 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/40c7d88b-5a53-471b-a758-d00925bc42d3-metrics-server-audit-profiles\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.393806 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393751 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40c7d88b-5a53-471b-a758-d00925bc42d3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.393880 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393812 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-secret-metrics-server-tls\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.393880 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393863 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86055f0e-dbab-4bf9-9578-b890b420db84-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-r82vn\" (UID: \"86055f0e-dbab-4bf9-9578-b890b420db84\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.393980 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.393902 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/40c7d88b-5a53-471b-a758-d00925bc42d3-audit-log\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.394420 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.394253 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/40c7d88b-5a53-471b-a758-d00925bc42d3-audit-log\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.394811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.394723 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/40c7d88b-5a53-471b-a758-d00925bc42d3-metrics-server-audit-profiles\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.394932 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.394819 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40c7d88b-5a53-471b-a758-d00925bc42d3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.396300 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.396274 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-secret-metrics-server-client-certs\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.396408 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.396388 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-client-ca-bundle\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.396466 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.396457 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/40c7d88b-5a53-471b-a758-d00925bc42d3-secret-metrics-server-tls\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.400865 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.400784 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:48.402682 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.402660 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvd8\" (UniqueName: \"kubernetes.io/projected/40c7d88b-5a53-471b-a758-d00925bc42d3-kube-api-access-dxvd8\") pod \"metrics-server-58dcf9444f-k472h\" (UID: \"40c7d88b-5a53-471b-a758-d00925bc42d3\") " pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.495314 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.495275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkcw\" (UniqueName: \"kubernetes.io/projected/86055f0e-dbab-4bf9-9578-b890b420db84-kube-api-access-wwkcw\") pod \"monitoring-plugin-589576dfc7-r82vn\" (UID: \"86055f0e-dbab-4bf9-9578-b890b420db84\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.495517 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.495372 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86055f0e-dbab-4bf9-9578-b890b420db84-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-r82vn\" (UID: \"86055f0e-dbab-4bf9-9578-b890b420db84\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.498322 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.498294 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86055f0e-dbab-4bf9-9578-b890b420db84-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-r82vn\" (UID: \"86055f0e-dbab-4bf9-9578-b890b420db84\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.504268 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.504219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwkcw\" (UniqueName: \"kubernetes.io/projected/86055f0e-dbab-4bf9-9578-b890b420db84-kube-api-access-wwkcw\") pod \"monitoring-plugin-589576dfc7-r82vn\" (UID: \"86055f0e-dbab-4bf9-9578-b890b420db84\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:48.535269 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.535233 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:11:48.541517 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.541440 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:48.655955 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:48.655915 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:11:49.802033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:49.801996 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:50.902539 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.902503 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bbd8cb455-6msd8"] Jun 11 23:11:50.906021 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.905990 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:50.908483 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.908453 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 23:11:50.908483 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.908463 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 23:11:50.909479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.909444 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 23:11:50.909742 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.909714 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 23:11:50.909874 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.909741 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:50.909938 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.909915 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 23:11:50.909994 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.909949 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4zqhf\"" Jun 11 23:11:50.914304 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.914278 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 23:11:50.922355 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.922326 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbd8cb455-6msd8"] Jun 11 23:11:50.991056 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:50.991012 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:51.023058 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-config\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.023219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023065 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-serving-cert\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.023219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-oauth-serving-cert\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.023219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023161 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-oauth-config\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.023219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023178 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn52n\" (UniqueName: \"kubernetes.io/projected/d1fd6d03-67fa-4a52-999b-9f9ee714e736-kube-api-access-nn52n\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.023219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-service-ca\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.023426 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.023291 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-trusted-ca-bundle\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124731 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-config\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124744 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-serving-cert\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124790 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-oauth-serving-cert\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124856 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-oauth-config\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124881 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn52n\" (UniqueName: \"kubernetes.io/projected/d1fd6d03-67fa-4a52-999b-9f9ee714e736-kube-api-access-nn52n\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124917 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-service-ca\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.124948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.124947 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-trusted-ca-bundle\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.125624 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.125597 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-oauth-serving-cert\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.125624 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.125612 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-service-ca\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.125799 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.125604 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-config\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.125891 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.125806 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-trusted-ca-bundle\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.127987 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.127959 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-oauth-config\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.128083 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.127967 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-serving-cert\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.133814 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.133788 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn52n\" (UniqueName: \"kubernetes.io/projected/d1fd6d03-67fa-4a52-999b-9f9ee714e736-kube-api-access-nn52n\") pod \"console-5bbd8cb455-6msd8\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:51.218462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:51.218371 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:11:53.896229 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:53.896185 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:53.953858 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:53.953806 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:54.520893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:54.520738 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-r82vn"] Jun 11 23:11:54.523436 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:54.523406 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86055f0e_dbab_4bf9_9578_b890b420db84.slice/crio-69e74ca2976daa053a045db7f28d15262e316694d53b7ed43abab8de982f7d50 WatchSource:0}: Error finding container 69e74ca2976daa053a045db7f28d15262e316694d53b7ed43abab8de982f7d50: Status 404 returned error can't find the container with id 69e74ca2976daa053a045db7f28d15262e316694d53b7ed43abab8de982f7d50 Jun 11 23:11:54.540316 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:54.540283 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58dcf9444f-k472h"] Jun 11 23:11:54.544297 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:54.544251 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c7d88b_5a53_471b_a758_d00925bc42d3.slice/crio-f9f05851ce04b1a6adde4a6de762831ceeba3e43f65d17fb56155620156248cd WatchSource:0}: Error finding container f9f05851ce04b1a6adde4a6de762831ceeba3e43f65d17fb56155620156248cd: Status 404 returned error can't find the container with id f9f05851ce04b1a6adde4a6de762831ceeba3e43f65d17fb56155620156248cd Jun 11 23:11:54.561232 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:54.561203 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbd8cb455-6msd8"] Jun 11 23:11:54.564379 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:11:54.564356 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fd6d03_67fa_4a52_999b_9f9ee714e736.slice/crio-f25498e2190536bdf4b40399daea7a10b355724fd00cf097b3cf4056ec7b89d7 WatchSource:0}: Error finding container f25498e2190536bdf4b40399daea7a10b355724fd00cf097b3cf4056ec7b89d7: Status 404 returned error can't find the container with id f25498e2190536bdf4b40399daea7a10b355724fd00cf097b3cf4056ec7b89d7 Jun 11 23:11:55.331360 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.330615 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-5c8jv" event={"ID":"df802e6c-a79a-48b9-bd56-236b0d6de8a8","Type":"ContainerStarted","Data":"187d6b027d300c7f58849577cdab7232fae9c12883b06a63f43a6a9b29ecf8f6"} Jun 11 23:11:55.334192 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.332213 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:55.334946 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.334796 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd8cb455-6msd8" event={"ID":"d1fd6d03-67fa-4a52-999b-9f9ee714e736","Type":"ContainerStarted","Data":"f25498e2190536bdf4b40399daea7a10b355724fd00cf097b3cf4056ec7b89d7"} Jun 11 23:11:55.341543 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.341476 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" event={"ID":"40c7d88b-5a53-471b-a758-d00925bc42d3","Type":"ContainerStarted","Data":"f9f05851ce04b1a6adde4a6de762831ceeba3e43f65d17fb56155620156248cd"} Jun 11 23:11:55.342187 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.342140 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-5c8jv" Jun 11 23:11:55.343586 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.343518 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" event={"ID":"86055f0e-dbab-4bf9-9578-b890b420db84","Type":"ContainerStarted","Data":"69e74ca2976daa053a045db7f28d15262e316694d53b7ed43abab8de982f7d50"} Jun 11 23:11:55.376659 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:55.375967 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-5c8jv" podStartSLOduration=2.118265474 podStartE2EDuration="18.375942965s" totalImagesPullingTime="16.257677491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:11:55.35649854 +0000 UTC m=+276.361936399" watchObservedRunningTime="2026-06-11 23:11:55.375942965 +0000 UTC m=+276.381380797" Jun 11 23:11:56.579554 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:56.579506 2571 patch_prober.go:28] interesting pod/image-registry-65db598dbf-pt9jp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:11:56.579996 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:56.579587 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:11:58.098552 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:58.098508 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:58.214081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:58.214004 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:11:58.278551 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:11:58.278494 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:00.913904 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:12:00.913855 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pgvp6" podUID="10cc11ea-396d-4ceb-8985-e9e53914cc9f" Jun 11 23:12:01.378789 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.378740 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd8cb455-6msd8" event={"ID":"d1fd6d03-67fa-4a52-999b-9f9ee714e736","Type":"ContainerStarted","Data":"887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8"} Jun 11 23:12:01.381102 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.380570 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" event={"ID":"40c7d88b-5a53-471b-a758-d00925bc42d3","Type":"ContainerStarted","Data":"d696b606b2734aa74c03d4377cb41c77a6bd589036b3e72144bfd3c3d911e459"} Jun 11 23:12:01.383305 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.383187 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"20887a23896c03fa5270dcce25aed5c034c3972306229f552af5bd05ae0f8923"} Jun 11 23:12:01.383305 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.383255 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"4648958ba73e93f4a1a2d9c7bafdacba8d8e3adca4c8ca7c76b6f3e4987354c2"} Jun 11 23:12:01.383305 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.383297 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"6480c6735e9c0d5d43868366784ac18b648de088b93c2f85b34ba3f4b28d789f"} Jun 11 23:12:01.386953 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.386926 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e"} Jun 11 23:12:01.389922 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.389449 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgvp6" Jun 11 23:12:01.394611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.394483 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:12:01.394611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.394529 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101"} Jun 11 23:12:01.394611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.394564 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0"} Jun 11 23:12:01.394611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.394588 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" event={"ID":"86055f0e-dbab-4bf9-9578-b890b420db84","Type":"ContainerStarted","Data":"9ef0ded6ad12d6e02890efb85058b0237ae23206f135fc319df45ac4eff32470"} Jun 11 23:12:01.395615 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.395590 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" Jun 11 23:12:01.399017 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.398968 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bbd8cb455-6msd8" podStartSLOduration=5.087738045 podStartE2EDuration="11.39895257s" totalImagesPullingTime="6.311214525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:01.397056413 +0000 UTC m=+282.402494265" watchObservedRunningTime="2026-06-11 23:12:01.39895257 +0000 UTC m=+282.404390397" Jun 11 23:12:01.416353 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.416294 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" podStartSLOduration=7.098344347 podStartE2EDuration="13.416276399s" totalImagesPullingTime="6.317932052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:01.413754411 +0000 UTC m=+282.419192241" watchObservedRunningTime="2026-06-11 23:12:01.416276399 +0000 UTC m=+282.421714230" Jun 11 23:12:01.434148 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.434006 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-r82vn" podStartSLOduration=7.09768071 podStartE2EDuration="13.433983767s" totalImagesPullingTime="6.336303057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:01.433530705 +0000 UTC m=+282.438968546" watchObservedRunningTime="2026-06-11 23:12:01.433983767 +0000 UTC m=+282.439421597" Jun 11 23:12:01.600082 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.599999 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerName="registry" containerID="cri-o://e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81" gracePeriod=30 Jun 11 23:12:01.954914 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:01.954566 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047457 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-image-registry-private-configuration\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047517 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-bound-sa-token\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047550 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-certificates\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047583 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-installation-pull-secrets\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047638 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047711 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdd233db-350a-420c-86a6-ce0e0894d7b3-ca-trust-extracted\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047751 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-trusted-ca\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.048263 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.047777 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqb9z\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-kube-api-access-kqb9z\") pod \"fdd233db-350a-420c-86a6-ce0e0894d7b3\" (UID: \"fdd233db-350a-420c-86a6-ce0e0894d7b3\") " Jun 11 23:12:02.051449 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.049588 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:02.051449 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.051406 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:12:02.051662 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.051622 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:02.052671 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.052549 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-kube-api-access-kqb9z" (OuterVolumeSpecName: "kube-api-access-kqb9z") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "kube-api-access-kqb9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:02.052671 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.052630 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:02.061768 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.061702 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdd233db-350a-420c-86a6-ce0e0894d7b3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:12:02.062940 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.062882 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:12:02.065158 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.065129 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fdd233db-350a-420c-86a6-ce0e0894d7b3" (UID: "fdd233db-350a-420c-86a6-ce0e0894d7b3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148851 2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-bound-sa-token\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148890 2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-certificates\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148906 2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-installation-pull-secrets\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148921 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-registry-tls\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148934 2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fdd233db-350a-420c-86a6-ce0e0894d7b3-ca-trust-extracted\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148947 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fdd233db-350a-420c-86a6-ce0e0894d7b3-trusted-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.148957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148961 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqb9z\" (UniqueName: \"kubernetes.io/projected/fdd233db-350a-420c-86a6-ce0e0894d7b3-kube-api-access-kqb9z\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.149396 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.148975 2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fdd233db-350a-420c-86a6-ce0e0894d7b3-image-registry-private-configuration\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:12:02.398430 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.398386 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06"} Jun 11 23:12:02.398700 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.398478 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d"} Jun 11 23:12:02.399856 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.399777 2571 generic.go:356] "Generic (PLEG): container finished" podID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerID="e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81" exitCode=0 Jun 11 23:12:02.399969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.399871 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" Jun 11 23:12:02.399969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.399865 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" event={"ID":"fdd233db-350a-420c-86a6-ce0e0894d7b3","Type":"ContainerDied","Data":"e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81"} Jun 11 23:12:02.400084 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.400015 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65db598dbf-pt9jp" event={"ID":"fdd233db-350a-420c-86a6-ce0e0894d7b3","Type":"ContainerDied","Data":"78b1c2968b12c4bf34652b4d7d97eaf83923bdf277d5e193e147e7e1a3371881"} Jun 11 23:12:02.400084 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.400054 2571 scope.go:117] "RemoveContainer" containerID="e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81" Jun 11 23:12:02.410210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.410189 2571 scope.go:117] "RemoveContainer" containerID="e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81" Jun 11 23:12:02.410682 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:12:02.410642 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81\": container with ID starting with e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81 not found: ID does not exist" containerID="e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81" Jun 11 23:12:02.410808 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.410684 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81"} err="failed to get container status \"e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81\": rpc error: code = NotFound desc = could not find container \"e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81\": container with ID starting with e9b78b04b35c721423b5e1b46992ba6896fdc481051d9a9e0dbb3cd798f38e81 not found: ID does not exist" Jun 11 23:12:02.425200 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.425171 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65db598dbf-pt9jp"] Jun 11 23:12:02.428671 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:02.428646 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65db598dbf-pt9jp"] Jun 11 23:12:03.394947 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.394865 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" path="/var/lib/kubelet/pods/fdd233db-350a-420c-86a6-ce0e0894d7b3/volumes" Jun 11 23:12:03.409456 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.409370 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"33c443c2894bdafbef535d9d8e8a5020c07e88ae74f110e639c94c11d6e1f50e"} Jun 11 23:12:03.409456 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.409457 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"f1aca9243d2a1b9dda076a5fca7ded43c055c7402a8e96e4ea15ade758a03cdd"} Jun 11 23:12:03.409698 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.409501 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" event={"ID":"d33727a0-9433-4ba6-87f1-be1223cbfd21","Type":"ContainerStarted","Data":"b85be2558e4099a8e015211cd5dae29855d6082c9b735f0e52ea0f959ec35a56"} Jun 11 23:12:03.409698 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.409574 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:12:03.413220 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.413186 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerStarted","Data":"fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e"} Jun 11 23:12:03.432683 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.432627 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" podStartSLOduration=2.220269387 podStartE2EDuration="17.43261145s" totalImagesPullingTime="15.212342063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:03.430452407 +0000 UTC m=+284.435890262" watchObservedRunningTime="2026-06-11 23:12:03.43261145 +0000 UTC m=+284.438049357" Jun 11 23:12:03.456398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:03.456328 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.3259053720000002 podStartE2EDuration="19.456307883s" totalImagesPullingTime="16.107814922s" totalInitContainerRuntime="22.587589ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:11:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:03.45591143 +0000 UTC m=+284.461349282" watchObservedRunningTime="2026-06-11 23:12:03.456307883 +0000 UTC m=+284.461745714" Jun 11 23:12:04.370942 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:04.370901 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:12:04.373233 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:04.373210 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10cc11ea-396d-4ceb-8985-e9e53914cc9f-metrics-tls\") pod \"dns-default-pgvp6\" (UID: \"10cc11ea-396d-4ceb-8985-e9e53914cc9f\") " pod="openshift-dns/dns-default-pgvp6" Jun 11 23:12:04.392932 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:04.392895 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p6jbq\"" Jun 11 23:12:04.400914 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:04.400883 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgvp6" Jun 11 23:12:04.564222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:04.564196 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgvp6"] Jun 11 23:12:04.566185 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:12:04.566159 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10cc11ea_396d_4ceb_8985_e9e53914cc9f.slice/crio-659c3ec6dcb7c847e6f5122a1695d739aee69235f7e7e5cdf5f44961a26e83c6 WatchSource:0}: Error finding container 659c3ec6dcb7c847e6f5122a1695d739aee69235f7e7e5cdf5f44961a26e83c6: Status 404 returned error can't find the container with id 659c3ec6dcb7c847e6f5122a1695d739aee69235f7e7e5cdf5f44961a26e83c6 Jun 11 23:12:05.424968 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:05.424931 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgvp6" event={"ID":"10cc11ea-396d-4ceb-8985-e9e53914cc9f","Type":"ContainerStarted","Data":"659c3ec6dcb7c847e6f5122a1695d739aee69235f7e7e5cdf5f44961a26e83c6"} Jun 11 23:12:07.435063 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:07.435026 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgvp6" event={"ID":"10cc11ea-396d-4ceb-8985-e9e53914cc9f","Type":"ContainerStarted","Data":"ad28b9bc036b9fb0910fceb19d0270a4c6f1980f3e3ca08a29e3b4fecf2e9b15"} Jun 11 23:12:07.435536 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:07.435079 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgvp6" event={"ID":"10cc11ea-396d-4ceb-8985-e9e53914cc9f","Type":"ContainerStarted","Data":"52a1205a8ea0a857d1fc881aaeb8d6e63bb7254d1c9eb2878e571c45e98cb649"} Jun 11 23:12:07.435536 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:07.435158 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pgvp6" Jun 11 23:12:07.452258 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:07.452201 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pgvp6" podStartSLOduration=251.540831627 podStartE2EDuration="4m13.452179728s" totalImagesPullingTime="1.911348101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:12:07.450778451 +0000 UTC m=+288.456216291" watchObservedRunningTime="2026-06-11 23:12:07.452179728 +0000 UTC m=+288.457617563" Jun 11 23:12:08.535700 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:08.535660 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:12:08.536113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:08.535719 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:12:09.054145 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:09.054111 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:09.108177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:09.108141 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:09.425275 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:09.425199 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66fb789b57-zd25w" Jun 11 23:12:11.219032 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:11.218983 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:12:11.219530 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:11.219099 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:12:11.220531 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:11.220505 2571 patch_prober.go:28] interesting pod/console-5bbd8cb455-6msd8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 11 23:12:11.220648 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:11.220551 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bbd8cb455-6msd8" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 11 23:12:17.442108 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:17.442076 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pgvp6" Jun 11 23:12:18.646929 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:18.646891 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:18.707630 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:18.707597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:19.341670 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:19.341644 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:12:19.342236 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:19.342216 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:12:19.349586 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:19.349556 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:12:19.350294 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:19.350275 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:12:19.353030 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:19.353012 2571 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 23:12:21.218838 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:21.218796 2571 patch_prober.go:28] interesting pod/console-5bbd8cb455-6msd8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 11 23:12:21.219244 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:21.218883 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bbd8cb455-6msd8" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 11 23:12:22.084766 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:22.084730 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:22.185493 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:22.185454 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:25.058249 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:25.058213 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:25.115125 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:25.115087 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:25.858962 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:25.858926 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:25.911773 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:25.911740 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:26.521109 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:26.521068 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:26.621200 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:26.621157 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:26.720957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:26.720919 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:27.058111 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:27.058064 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:27.159185 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:27.159132 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:27.214619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:27.214587 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:28.541649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:28.541621 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:12:28.545464 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:28.545438 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58dcf9444f-k472h" Jun 11 23:12:31.223514 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:31.223478 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:12:31.227356 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:31.227325 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:12:31.403118 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:31.403083 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:31.458249 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:31.458198 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:31.518649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:31.518549 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:32.035223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:32.035189 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:32.090093 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:32.090061 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:41.109334 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:41.109298 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:41.159468 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:41.159432 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:43.799770 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:43.799737 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:43.925595 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:43.925543 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:44.026045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:44.026011 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:44.594930 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:44.594890 2571 generic.go:356] "Generic (PLEG): container finished" podID="d85eef17-528e-4e24-be3f-d2306b8f2199" containerID="96aecdb4f2b99fc7690033cc0e3b396889b44b494b102594b0a683a4720035cd" exitCode=0 Jun 11 23:12:44.595270 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:44.594995 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" event={"ID":"d85eef17-528e-4e24-be3f-d2306b8f2199","Type":"ContainerDied","Data":"96aecdb4f2b99fc7690033cc0e3b396889b44b494b102594b0a683a4720035cd"} Jun 11 23:12:44.595887 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:44.595856 2571 scope.go:117] "RemoveContainer" containerID="96aecdb4f2b99fc7690033cc0e3b396889b44b494b102594b0a683a4720035cd" Jun 11 23:12:45.601028 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:45.600993 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-9j85f" event={"ID":"d85eef17-528e-4e24-be3f-d2306b8f2199","Type":"ContainerStarted","Data":"5eb9d2b58c048e084a353795a245e279d0c1c5e526fd2797afd03183f2b1d7f4"} Jun 11 23:12:45.881727 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:45.881640 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w6ztn_de5c634a-5ae9-4ca7-b9db-0539ef234807/node-ca/0.log" Jun 11 23:12:46.282344 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:46.282313 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cbd7b74b-cf2pt_627f4c2a-08eb-4c6a-acc3-a8754010d1bb/router/0.log" Jun 11 23:12:46.482047 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:46.482020 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pc6c8_d68b326b-ee84-4b8a-8ba0-7ac9b8659708/serve-healthcheck-canary/0.log" Jun 11 23:12:52.100408 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:52.100366 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:52.171189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:52.171155 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:59.011516 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:59.011467 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:59.110744 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:59.110703 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:12:59.169670 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:12:59.169634 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:02.773064 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:02.773011 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:02.974868 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:02.974807 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:03.843520 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843481 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:13:03.843949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843752 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="alertmanager" containerID="cri-o://3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0" gracePeriod=120 Jun 11 23:13:03.843949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843848 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-metric" containerID="cri-o://3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06" gracePeriod=120 Jun 11 23:13:03.843949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843869 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-web" containerID="cri-o://ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e" gracePeriod=120 Jun 11 23:13:03.843949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843893 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy" containerID="cri-o://b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d" gracePeriod=120 Jun 11 23:13:03.843949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843913 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="config-reloader" containerID="cri-o://5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101" gracePeriod=120 Jun 11 23:13:03.844205 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:03.843977 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="prom-label-proxy" containerID="cri-o://fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e" gracePeriod=120 Jun 11 23:13:04.688741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688710 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e" exitCode=0 Jun 11 23:13:04.688741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688736 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06" exitCode=0 Jun 11 23:13:04.688741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688745 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d" exitCode=0 Jun 11 23:13:04.688741 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688752 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101" exitCode=0 Jun 11 23:13:04.689033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688759 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0" exitCode=0 Jun 11 23:13:04.689033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688777 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e"} Jun 11 23:13:04.689033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688858 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06"} Jun 11 23:13:04.689033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688888 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d"} Jun 11 23:13:04.689033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688923 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101"} Jun 11 23:13:04.689033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.688947 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0"} Jun 11 23:13:04.935661 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.935629 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:04.984545 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:04.984508 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:05.094943 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.094914 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.195255 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195164 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-main-db\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195255 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195203 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195255 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195250 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-volume\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195274 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-metrics-client-ca\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195331 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195358 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-web-config\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195381 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2jqx\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-kube-api-access-p2jqx\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195415 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-out\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195446 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-cluster-tls-config\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195473 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-trusted-ca-bundle\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195527 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195518 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195985 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195518 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:13:05.195985 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195554 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-main-tls\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.195985 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.195650 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:13:05.196556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.196143 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:13:05.196556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.196187 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-tls-assets\") pod \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\" (UID: \"ce1fc4a2-dcda-4586-9699-5037c4df1cfb\") " Jun 11 23:13:05.196556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.196477 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-main-db\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.196556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.196497 2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-metrics-client-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.196556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.196513 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.198841 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.198125 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.198841 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.198245 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.198841 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.198500 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-kube-api-access-p2jqx" (OuterVolumeSpecName: "kube-api-access-p2jqx") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "kube-api-access-p2jqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:13:05.198841 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.198683 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.199718 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.199197 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-volume" (OuterVolumeSpecName: "config-volume") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.199943 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.199905 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-out" (OuterVolumeSpecName: "config-out") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:13:05.200054 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.200022 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.200145 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.200124 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:13:05.203228 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.203167 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.211840 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.211792 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-web-config" (OuterVolumeSpecName: "web-config") pod "ce1fc4a2-dcda-4586-9699-5037c4df1cfb" (UID: "ce1fc4a2-dcda-4586-9699-5037c4df1cfb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:05.297223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297181 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297215 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-main-tls\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297225 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-tls-assets\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297235 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297248 2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-volume\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297256 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297264 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-web-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297273 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2jqx\" (UniqueName: \"kubernetes.io/projected/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-kube-api-access-p2jqx\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297282 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-config-out\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.297452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.297290 2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1fc4a2-dcda-4586-9699-5037c4df1cfb-cluster-tls-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:05.695906 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.695867 2571 generic.go:356] "Generic (PLEG): container finished" podID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerID="ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e" exitCode=0 Jun 11 23:13:05.696077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.695939 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e"} Jun 11 23:13:05.696077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.695961 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.696077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.696010 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1fc4a2-dcda-4586-9699-5037c4df1cfb","Type":"ContainerDied","Data":"bfcd5b7ee1a32567d0554b0833c4f326ce2b013d6ef4ade6f6543a648d33da77"} Jun 11 23:13:05.696077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.696046 2571 scope.go:117] "RemoveContainer" containerID="fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e" Jun 11 23:13:05.704038 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.704021 2571 scope.go:117] "RemoveContainer" containerID="3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06" Jun 11 23:13:05.711029 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.711008 2571 scope.go:117] "RemoveContainer" containerID="b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d" Jun 11 23:13:05.718335 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.718315 2571 scope.go:117] "RemoveContainer" containerID="ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e" Jun 11 23:13:05.718419 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.718397 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:13:05.722650 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.722630 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:13:05.725421 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.725403 2571 scope.go:117] "RemoveContainer" containerID="5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101" Jun 11 23:13:05.732485 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.732466 2571 scope.go:117] "RemoveContainer" containerID="3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0" Jun 11 23:13:05.739621 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.739553 2571 scope.go:117] "RemoveContainer" containerID="fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3" Jun 11 23:13:05.746375 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.746359 2571 scope.go:117] "RemoveContainer" containerID="fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e" Jun 11 23:13:05.746643 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.746622 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e\": container with ID starting with fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e not found: ID does not exist" containerID="fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e" Jun 11 23:13:05.746694 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.746654 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e"} err="failed to get container status \"fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e\": rpc error: code = NotFound desc = could not find container \"fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e\": container with ID starting with fe9b4685ef0c2ae8843b19760e9af93ca4fb6898e611d2d8559bc2cb6522e07e not found: ID does not exist" Jun 11 23:13:05.746694 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.746676 2571 scope.go:117] "RemoveContainer" containerID="3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06" Jun 11 23:13:05.746970 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.746950 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06\": container with ID starting with 3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06 not found: ID does not exist" containerID="3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06" Jun 11 23:13:05.747017 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.746981 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06"} err="failed to get container status \"3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06\": rpc error: code = NotFound desc = could not find container \"3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06\": container with ID starting with 3fe67a6225845b1e8286f500ba2aefe7402d38bca8bfd21304f1cc651a773d06 not found: ID does not exist" Jun 11 23:13:05.747017 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.747003 2571 scope.go:117] "RemoveContainer" containerID="b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d" Jun 11 23:13:05.747303 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.747275 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d\": container with ID starting with b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d not found: ID does not exist" containerID="b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d" Jun 11 23:13:05.747485 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.747309 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d"} err="failed to get container status \"b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d\": rpc error: code = NotFound desc = could not find container \"b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d\": container with ID starting with b452e3282e9130c5457aa6f0fb84aaaac6803e748f74cedc4efad64c98760e3d not found: ID does not exist" Jun 11 23:13:05.747485 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.747332 2571 scope.go:117] "RemoveContainer" containerID="ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e" Jun 11 23:13:05.747712 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.747688 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e\": container with ID starting with ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e not found: ID does not exist" containerID="ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e" Jun 11 23:13:05.747788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.747719 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e"} err="failed to get container status \"ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e\": rpc error: code = NotFound desc = could not find container \"ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e\": container with ID starting with ab43e363b8c2dab3f5fb5d6dae2b5b13b48b752b19e55661f1353839b112ac3e not found: ID does not exist" Jun 11 23:13:05.747863 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.747817 2571 scope.go:117] "RemoveContainer" containerID="5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101" Jun 11 23:13:05.748117 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.748091 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101\": container with ID starting with 5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101 not found: ID does not exist" containerID="5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101" Jun 11 23:13:05.748218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.748121 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101"} err="failed to get container status \"5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101\": rpc error: code = NotFound desc = could not find container \"5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101\": container with ID starting with 5ec2aa1bc9c230d87f5a6a475cd9e74ff5ac5ee28ea41858c8f2750728df6101 not found: ID does not exist" Jun 11 23:13:05.748218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.748140 2571 scope.go:117] "RemoveContainer" containerID="3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0" Jun 11 23:13:05.748500 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.748463 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0\": container with ID starting with 3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0 not found: ID does not exist" containerID="3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0" Jun 11 23:13:05.748561 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.748502 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0"} err="failed to get container status \"3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0\": rpc error: code = NotFound desc = could not find container \"3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0\": container with ID starting with 3e6824825312bae2cf0ff7beefb97114bd93a861f2fbd28fb48af848912f14d0 not found: ID does not exist" Jun 11 23:13:05.748561 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.748525 2571 scope.go:117] "RemoveContainer" containerID="fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3" Jun 11 23:13:05.748771 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:05.748753 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3\": container with ID starting with fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3 not found: ID does not exist" containerID="fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3" Jun 11 23:13:05.748814 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.748776 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3"} err="failed to get container status \"fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3\": rpc error: code = NotFound desc = could not find container \"fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3\": container with ID starting with fef7b06dd22205b3fd3a3c2f2854bbef3f7f00b594b6473cef2302bb66bef6e3 not found: ID does not exist" Jun 11 23:13:05.749486 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749469 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:13:05.749768 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749758 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-metric" Jun 11 23:13:05.749800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749770 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-metric" Jun 11 23:13:05.749800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749781 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy" Jun 11 23:13:05.749800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749788 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy" Jun 11 23:13:05.749800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749797 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-web" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749803 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-web" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749812 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="init-config-reloader" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749818 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="init-config-reloader" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749843 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="config-reloader" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749849 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="config-reloader" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749861 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="alertmanager" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749865 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="alertmanager" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749874 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="prom-label-proxy" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749879 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="prom-label-proxy" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749886 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerName="registry" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749891 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerName="registry" Jun 11 23:13:05.749936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749935 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-metric" Jun 11 23:13:05.750264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749943 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="prom-label-proxy" Jun 11 23:13:05.750264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749950 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd233db-350a-420c-86a6-ce0e0894d7b3" containerName="registry" Jun 11 23:13:05.750264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749956 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="alertmanager" Jun 11 23:13:05.750264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749962 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="config-reloader" Jun 11 23:13:05.750264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749967 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy" Jun 11 23:13:05.750264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.749973 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" containerName="kube-rbac-proxy-web" Jun 11 23:13:05.753743 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.753725 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.756171 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756153 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 23:13:05.756320 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756290 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 23:13:05.756404 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756317 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 23:13:05.756461 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756442 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 23:13:05.756513 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756471 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 23:13:05.756566 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756510 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dc628\"" Jun 11 23:13:05.756566 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756520 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 23:13:05.756566 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756537 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 23:13:05.756566 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.756554 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 23:13:05.761390 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.761371 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 23:13:05.767141 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.767119 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:13:05.900801 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900761 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-web-config\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.900801 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900859 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ace9088-f4f7-4c64-8af1-602b09232cd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900894 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ace9088-f4f7-4c64-8af1-602b09232cd1-config-out\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900910 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ace9088-f4f7-4c64-8af1-602b09232cd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900931 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ace9088-f4f7-4c64-8af1-602b09232cd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900952 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900967 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpcj\" (UniqueName: \"kubernetes.io/projected/7ace9088-f4f7-4c64-8af1-602b09232cd1-kube-api-access-jrpcj\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.900992 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.901005 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ace9088-f4f7-4c64-8af1-602b09232cd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.901039 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901325 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.901053 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:05.901325 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:05.901070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002493 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002458 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ace9088-f4f7-4c64-8af1-602b09232cd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002502 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpcj\" (UniqueName: \"kubernetes.io/projected/7ace9088-f4f7-4c64-8af1-602b09232cd1-kube-api-access-jrpcj\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002669 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002720 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ace9088-f4f7-4c64-8af1-602b09232cd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002768 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002794 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002817 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002909 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-web-config\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002941 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.002991 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.002980 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ace9088-f4f7-4c64-8af1-602b09232cd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.003619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.003017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ace9088-f4f7-4c64-8af1-602b09232cd1-config-out\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.003619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.003040 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ace9088-f4f7-4c64-8af1-602b09232cd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.003619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.003586 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ace9088-f4f7-4c64-8af1-602b09232cd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.004192 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.004162 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ace9088-f4f7-4c64-8af1-602b09232cd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.004492 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.004469 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ace9088-f4f7-4c64-8af1-602b09232cd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.005545 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.005517 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.005773 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.005748 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.005865 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.005791 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ace9088-f4f7-4c64-8af1-602b09232cd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.006448 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.006398 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.006546 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.006511 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.006610 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.006584 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.006678 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.006652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.007002 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.006985 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ace9088-f4f7-4c64-8af1-602b09232cd1-config-out\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.007507 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.007489 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ace9088-f4f7-4c64-8af1-602b09232cd1-web-config\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.009920 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.009902 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpcj\" (UniqueName: \"kubernetes.io/projected/7ace9088-f4f7-4c64-8af1-602b09232cd1-kube-api-access-jrpcj\") pod \"alertmanager-main-0\" (UID: \"7ace9088-f4f7-4c64-8af1-602b09232cd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.063503 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.063474 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 23:13:06.201122 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.201025 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 23:13:06.203864 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:13:06.203834 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ace9088_f4f7_4c64_8af1_602b09232cd1.slice/crio-f99379f9f41136e4fd6590114d251a2cdf3721983abc21a60564ff01b2615673 WatchSource:0}: Error finding container f99379f9f41136e4fd6590114d251a2cdf3721983abc21a60564ff01b2615673: Status 404 returned error can't find the container with id f99379f9f41136e4fd6590114d251a2cdf3721983abc21a60564ff01b2615673 Jun 11 23:13:06.701630 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.701592 2571 generic.go:356] "Generic (PLEG): container finished" podID="7ace9088-f4f7-4c64-8af1-602b09232cd1" containerID="26a4e32ed2d09a8b2e1688f524ff16cfa18feaf6da1d82875de0f972cb1bc493" exitCode=0 Jun 11 23:13:06.701864 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.701677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerDied","Data":"26a4e32ed2d09a8b2e1688f524ff16cfa18feaf6da1d82875de0f972cb1bc493"} Jun 11 23:13:06.701864 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:06.701746 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"f99379f9f41136e4fd6590114d251a2cdf3721983abc21a60564ff01b2615673"} Jun 11 23:13:07.077133 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.077102 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:07.124844 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.124792 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:07.393662 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.393567 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1fc4a2-dcda-4586-9699-5037c4df1cfb" path="/var/lib/kubelet/pods/ce1fc4a2-dcda-4586-9699-5037c4df1cfb/volumes" Jun 11 23:13:07.709681 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.709598 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"ec30f1b3a9aabb7fa10445ede91a6181779fe5ca9f56e9d2fb7377c5fe76a8a6"} Jun 11 23:13:07.709816 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.709682 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"92016fc37a0b70bb2c084dcfefa50e718dad7785cf829fa9b3f4a6051a3f7ae0"} Jun 11 23:13:07.709816 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.709724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"4a3e539c850130508c6e397c575357c2d358ace0e54ef03773f8c4e1064e293a"} Jun 11 23:13:07.709816 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.709762 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"f08e4b523aaab2ba16de8e6a4f86381a867e8c4d1243d3021a2ed5cb577c5fd3"} Jun 11 23:13:07.709816 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.709799 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"8efa95ff8220aae5090bdb1aa2edc81b45392ca77a89954546eb80493baa6e01"} Jun 11 23:13:07.709969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.709856 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ace9088-f4f7-4c64-8af1-602b09232cd1","Type":"ContainerStarted","Data":"e19ae2a269acbed3ca58710604cd691c2c41e315f203d59c042a3cf3fc1d6dba"} Jun 11 23:13:07.736046 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.735992 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.720034006 podStartE2EDuration="2.735973434s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.939428ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:13:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:13:07.733929291 +0000 UTC m=+348.739367143" watchObservedRunningTime="2026-06-11 23:13:07.735973434 +0000 UTC m=+348.741411264" Jun 11 23:13:07.869295 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.869256 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms"] Jun 11 23:13:07.872044 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.872026 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.874875 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.874846 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6hxq5\"" Jun 11 23:13:07.874983 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.874881 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 23:13:07.874983 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.874893 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 23:13:07.874983 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.874887 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 23:13:07.875232 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.875004 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 23:13:07.875293 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.875282 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 23:13:07.881190 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.881171 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 23:13:07.888422 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.888399 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms"] Jun 11 23:13:07.920132 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920097 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-federate-client-tls\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920132 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920141 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920163 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-metrics-client-ca\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920282 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-serving-certs-ca-bundle\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920313 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-telemeter-client-tls\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920336 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chqt9\" (UniqueName: \"kubernetes.io/projected/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-kube-api-access-chqt9\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:07.920398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:07.920371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-secret-telemeter-client\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021576 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021618 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021639 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-metrics-client-ca\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021660 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-serving-certs-ca-bundle\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021682 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-telemeter-client-tls\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021697 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chqt9\" (UniqueName: \"kubernetes.io/projected/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-kube-api-access-chqt9\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.021764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021723 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-secret-telemeter-client\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.022105 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.021783 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-federate-client-tls\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.022503 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.022469 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-metrics-client-ca\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.022625 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.022480 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-serving-certs-ca-bundle\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.022697 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.022640 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.024225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.024202 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.024329 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.024311 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-secret-telemeter-client\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.024534 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.024516 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-telemeter-client-tls\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.024609 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.024591 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-federate-client-tls\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.030579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.030556 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chqt9\" (UniqueName: \"kubernetes.io/projected/2766e4db-2d3d-4e74-beb7-d7ecb0f31eef-kube-api-access-chqt9\") pod \"telemeter-client-6fd7cfb4b6-jtfms\" (UID: \"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef\") " pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.181556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.181488 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" Jun 11 23:13:08.324634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.324605 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms"] Jun 11 23:13:08.326903 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:13:08.326878 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2766e4db_2d3d_4e74_beb7_d7ecb0f31eef.slice/crio-11b288af04e39f4c0a67e9578b4f72e625dd89c7f87ba04c5e757f33acb01ed4 WatchSource:0}: Error finding container 11b288af04e39f4c0a67e9578b4f72e625dd89c7f87ba04c5e757f33acb01ed4: Status 404 returned error can't find the container with id 11b288af04e39f4c0a67e9578b4f72e625dd89c7f87ba04c5e757f33acb01ed4 Jun 11 23:13:08.328905 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.328885 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:13:08.717802 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:08.717701 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" event={"ID":"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef","Type":"ContainerStarted","Data":"11b288af04e39f4c0a67e9578b4f72e625dd89c7f87ba04c5e757f33acb01ed4"} Jun 11 23:13:10.727728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:10.727688 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" event={"ID":"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef","Type":"ContainerStarted","Data":"1540c351a696df3e88069547665a902e47022b2a9fef75ba8673ffd7b852f550"} Jun 11 23:13:10.728151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:10.727768 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" event={"ID":"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef","Type":"ContainerStarted","Data":"1a1d60daec9b0b6c96cd3bd166a086aa499a8643f0d55486c1e2ecad03d77faa"} Jun 11 23:13:10.728151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:10.727791 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" event={"ID":"2766e4db-2d3d-4e74-beb7-d7ecb0f31eef","Type":"ContainerStarted","Data":"d9f1f8f19b32050968b84cb73987e8012984d7c04d7432da8fa2b1d9fab7b2b1"} Jun 11 23:13:10.749516 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:10.749467 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fd7cfb4b6-jtfms" podStartSLOduration=1.909601244 podStartE2EDuration="3.749451233s" totalImagesPullingTime="1.839849989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:13:10.747158623 +0000 UTC m=+351.752596498" watchObservedRunningTime="2026-06-11 23:13:10.749451233 +0000 UTC m=+351.754889063" Jun 11 23:13:11.399970 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.399932 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65c644f8b-28rqk"] Jun 11 23:13:11.403988 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.403962 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.406493 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.406469 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c644f8b-28rqk"] Jun 11 23:13:11.442391 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.442353 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:11.450745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450713 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-config\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.450745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450756 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-serving-cert\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.451177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450778 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-service-ca\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.451177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450859 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-oauth-config\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.451177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4dmv\" (UniqueName: \"kubernetes.io/projected/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-kube-api-access-z4dmv\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.451177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450954 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-trusted-ca-bundle\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.451177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.450993 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-oauth-serving-cert\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.502545 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.502510 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:11.551873 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.551810 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-config\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.551873 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.551879 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-serving-cert\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.551899 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-service-ca\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.551919 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-oauth-config\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.551948 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4dmv\" (UniqueName: \"kubernetes.io/projected/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-kube-api-access-z4dmv\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.551970 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-trusted-ca-bundle\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.552002 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-oauth-serving-cert\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552690 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.552663 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-config\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552807 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.552663 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-service-ca\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.552806 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-trusted-ca-bundle\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.552956 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.552930 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-oauth-serving-cert\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.554539 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.554520 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-serving-cert\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.554623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.554555 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-oauth-config\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.559574 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.559551 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4dmv\" (UniqueName: \"kubernetes.io/projected/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-kube-api-access-z4dmv\") pod \"console-65c644f8b-28rqk\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.594564 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.594531 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:11.650352 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.650238 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:11.715745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.715717 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:11.879187 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:11.879158 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c644f8b-28rqk"] Jun 11 23:13:11.882107 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:13:11.882077 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e70b5e6_1196_4d2b_9e18_3d2648e14fdd.slice/crio-11afbd83ba15e6f14cb990e107bb460e32731d16b47376e79c2f497b0f7c1678 WatchSource:0}: Error finding container 11afbd83ba15e6f14cb990e107bb460e32731d16b47376e79c2f497b0f7c1678: Status 404 returned error can't find the container with id 11afbd83ba15e6f14cb990e107bb460e32731d16b47376e79c2f497b0f7c1678 Jun 11 23:13:12.185214 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:12.185127 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:12.285883 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:12.285846 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:12.739252 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:12.739215 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c644f8b-28rqk" event={"ID":"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd","Type":"ContainerStarted","Data":"33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138"} Jun 11 23:13:12.739436 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:12.739267 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c644f8b-28rqk" event={"ID":"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd","Type":"ContainerStarted","Data":"11afbd83ba15e6f14cb990e107bb460e32731d16b47376e79c2f497b0f7c1678"} Jun 11 23:13:12.756954 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:12.756897 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65c644f8b-28rqk" podStartSLOduration=1.7568798079999999 podStartE2EDuration="1.756879808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:13:12.754769631 +0000 UTC m=+353.760207489" watchObservedRunningTime="2026-06-11 23:13:12.756879808 +0000 UTC m=+353.762317698" Jun 11 23:13:21.716195 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.716165 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:21.716578 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.716219 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:21.720893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.720872 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:21.782584 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.782556 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:13:21.826638 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.826605 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bbd8cb455-6msd8"] Jun 11 23:13:21.933596 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.933558 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:21.994663 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:21.994619 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:22.049149 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:22.049110 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:22.105082 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:22.105039 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:13:46.850371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:46.850326 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bbd8cb455-6msd8" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerName="console" containerID="cri-o://887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8" gracePeriod=15 Jun 11 23:13:47.099456 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.099423 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:13:47.273268 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273232 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-oauth-config\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273292 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-service-ca\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273318 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-oauth-serving-cert\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273356 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-config\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273381 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn52n\" (UniqueName: \"kubernetes.io/projected/d1fd6d03-67fa-4a52-999b-9f9ee714e736-kube-api-access-nn52n\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273417 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-serving-cert\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273477 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273439 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-trusted-ca-bundle\") pod \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\" (UID: \"d1fd6d03-67fa-4a52-999b-9f9ee714e736\") " Jun 11 23:13:47.273914 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273870 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:13:47.274037 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273908 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-config" (OuterVolumeSpecName: "console-config") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:13:47.274037 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.273994 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:13:47.274037 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.274000 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:13:47.275672 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.275651 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1fd6d03-67fa-4a52-999b-9f9ee714e736-kube-api-access-nn52n" (OuterVolumeSpecName: "kube-api-access-nn52n") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "kube-api-access-nn52n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:13:47.275972 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.275953 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:47.276022 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.275998 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1fd6d03-67fa-4a52-999b-9f9ee714e736" (UID: "d1fd6d03-67fa-4a52-999b-9f9ee714e736"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:13:47.374486 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374444 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn52n\" (UniqueName: \"kubernetes.io/projected/d1fd6d03-67fa-4a52-999b-9f9ee714e736-kube-api-access-nn52n\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.374486 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374478 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.374486 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374487 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.374486 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374496 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-oauth-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.374751 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374505 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-service-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.374751 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374514 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-oauth-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.374751 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.374524 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1fd6d03-67fa-4a52-999b-9f9ee714e736-console-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:13:47.888731 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.888694 2571 generic.go:356] "Generic (PLEG): container finished" podID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerID="887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8" exitCode=0 Jun 11 23:13:47.888731 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.888734 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd8cb455-6msd8" event={"ID":"d1fd6d03-67fa-4a52-999b-9f9ee714e736","Type":"ContainerDied","Data":"887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8"} Jun 11 23:13:47.889213 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.888740 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd8cb455-6msd8" Jun 11 23:13:47.889213 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.888778 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd8cb455-6msd8" event={"ID":"d1fd6d03-67fa-4a52-999b-9f9ee714e736","Type":"ContainerDied","Data":"f25498e2190536bdf4b40399daea7a10b355724fd00cf097b3cf4056ec7b89d7"} Jun 11 23:13:47.889213 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.888799 2571 scope.go:117] "RemoveContainer" containerID="887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8" Jun 11 23:13:47.897029 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.897009 2571 scope.go:117] "RemoveContainer" containerID="887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8" Jun 11 23:13:47.897287 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:13:47.897270 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8\": container with ID starting with 887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8 not found: ID does not exist" containerID="887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8" Jun 11 23:13:47.897336 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.897296 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8"} err="failed to get container status \"887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8\": rpc error: code = NotFound desc = could not find container \"887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8\": container with ID starting with 887512dd9dc7de12807ecf6b7ad65b98628b385e8f4bf61c6467cc11e0a9eeb8 not found: ID does not exist" Jun 11 23:13:47.904612 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.904588 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bbd8cb455-6msd8"] Jun 11 23:13:47.908320 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:47.908301 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bbd8cb455-6msd8"] Jun 11 23:13:49.398159 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:13:49.398124 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" path="/var/lib/kubelet/pods/d1fd6d03-67fa-4a52-999b-9f9ee714e736/volumes" Jun 11 23:14:15.474809 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:15.474756 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:15.577399 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:15.577352 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:18.035561 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:18.035522 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:18.137893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:18.137862 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:27.857148 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.857107 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf45d5786-pmnh2"] Jun 11 23:14:27.857529 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.857464 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerName="console" Jun 11 23:14:27.857529 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.857477 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerName="console" Jun 11 23:14:27.857612 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.857532 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1fd6d03-67fa-4a52-999b-9f9ee714e736" containerName="console" Jun 11 23:14:27.860930 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.860899 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.872378 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.872349 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf45d5786-pmnh2"] Jun 11 23:14:27.909909 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.909857 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:27.925974 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.925935 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6tg\" (UniqueName: \"kubernetes.io/projected/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-kube-api-access-4b6tg\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.925974 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.925975 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-oauth-config\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.926169 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.925997 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-serving-cert\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.926169 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.926015 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-trusted-ca-bundle\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.926169 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.926038 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-oauth-serving-cert\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.926169 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.926060 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-config\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.926169 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.926103 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-service-ca\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:27.961097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:27.961062 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:28.026976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.026937 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6tg\" (UniqueName: \"kubernetes.io/projected/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-kube-api-access-4b6tg\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.027174 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.026985 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-oauth-config\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.027174 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.027011 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-serving-cert\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.027174 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.027050 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-trusted-ca-bundle\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.027349 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.027234 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-oauth-serving-cert\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.027349 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.027291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-config\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.027349 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.027324 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-service-ca\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.028021 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.027998 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-service-ca\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.028021 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.028006 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-oauth-serving-cert\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.028168 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.028066 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-config\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.028168 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.028099 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-trusted-ca-bundle\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.030026 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.030005 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-oauth-config\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.030221 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.030202 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-serving-cert\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.035143 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.035121 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6tg\" (UniqueName: \"kubernetes.io/projected/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-kube-api-access-4b6tg\") pod \"console-6cf45d5786-pmnh2\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.060685 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.060652 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:28.160459 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.160365 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:28.171336 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.171303 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:28.309048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.309016 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf45d5786-pmnh2"] Jun 11 23:14:28.311761 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:14:28.311732 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fe4db7_7c24_4bf4_bb05_fc2ad6dc1973.slice/crio-52406ad72513a330cf7a9ce811e1814cf1b93aa0cec8d4e961ca277fa192fbf5 WatchSource:0}: Error finding container 52406ad72513a330cf7a9ce811e1814cf1b93aa0cec8d4e961ca277fa192fbf5: Status 404 returned error can't find the container with id 52406ad72513a330cf7a9ce811e1814cf1b93aa0cec8d4e961ca277fa192fbf5 Jun 11 23:14:28.652405 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.652370 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:28.707316 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:28.707282 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:29.060689 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:29.060647 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf45d5786-pmnh2" event={"ID":"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973","Type":"ContainerStarted","Data":"035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8"} Jun 11 23:14:29.061090 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:29.060708 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf45d5786-pmnh2" event={"ID":"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973","Type":"ContainerStarted","Data":"52406ad72513a330cf7a9ce811e1814cf1b93aa0cec8d4e961ca277fa192fbf5"} Jun 11 23:14:29.077703 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:29.077653 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cf45d5786-pmnh2" podStartSLOduration=2.077633074 podStartE2EDuration="2.077633074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:14:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:14:29.076897237 +0000 UTC m=+430.082335092" watchObservedRunningTime="2026-06-11 23:14:29.077633074 +0000 UTC m=+430.083070904" Jun 11 23:14:29.902349 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:29.902303 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:29.955523 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:29.955482 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:37.078295 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:37.078257 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:37.179033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:37.178997 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:37.233800 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:37.233756 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:38.171564 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:38.171482 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:38.171958 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:38.171714 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:38.176663 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:38.176641 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:39.103941 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:39.103910 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:14:39.148715 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:39.148624 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c644f8b-28rqk"] Jun 11 23:14:39.263571 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:39.263538 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:39.367669 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:39.367579 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:14:39.466517 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:14:39.466473 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:04.176855 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.176803 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65c644f8b-28rqk" podUID="6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" containerName="console" containerID="cri-o://33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138" gracePeriod=15 Jun 11 23:15:04.413607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.413577 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:15:04.444815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.444729 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-serving-cert\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.444815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.444785 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-config\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.445048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.444893 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4dmv\" (UniqueName: \"kubernetes.io/projected/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-kube-api-access-z4dmv\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.445048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.444913 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-oauth-config\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.445048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.444932 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-trusted-ca-bundle\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.445048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.444958 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-oauth-serving-cert\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.445048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.445003 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-service-ca\") pod \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\" (UID: \"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd\") " Jun 11 23:15:04.445356 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.445254 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-config" (OuterVolumeSpecName: "console-config") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:15:04.445611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.445506 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:15:04.445611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.445539 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:15:04.445801 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.445685 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:15:04.447217 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.447192 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:15:04.447217 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.447190 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-kube-api-access-z4dmv" (OuterVolumeSpecName: "kube-api-access-z4dmv") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "kube-api-access-z4dmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:15:04.447431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.447417 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" (UID: "6e70b5e6-1196-4d2b-9e18-3d2648e14fdd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:15:04.546428 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546395 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4dmv\" (UniqueName: \"kubernetes.io/projected/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-kube-api-access-z4dmv\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:04.546428 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546421 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-oauth-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:04.546428 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546431 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:04.546656 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546439 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-oauth-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:04.546656 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546449 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-service-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:04.546656 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546457 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:04.546656 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:04.546465 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd-console-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:05.202425 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.202392 2571 generic.go:356] "Generic (PLEG): container finished" podID="6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" containerID="33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138" exitCode=0 Jun 11 23:15:05.202425 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.202430 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c644f8b-28rqk" event={"ID":"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd","Type":"ContainerDied","Data":"33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138"} Jun 11 23:15:05.202955 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.202450 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c644f8b-28rqk" Jun 11 23:15:05.202955 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.202494 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c644f8b-28rqk" event={"ID":"6e70b5e6-1196-4d2b-9e18-3d2648e14fdd","Type":"ContainerDied","Data":"11afbd83ba15e6f14cb990e107bb460e32731d16b47376e79c2f497b0f7c1678"} Jun 11 23:15:05.202955 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.202515 2571 scope.go:117] "RemoveContainer" containerID="33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138" Jun 11 23:15:05.211471 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.211453 2571 scope.go:117] "RemoveContainer" containerID="33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138" Jun 11 23:15:05.211743 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:15:05.211720 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138\": container with ID starting with 33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138 not found: ID does not exist" containerID="33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138" Jun 11 23:15:05.211808 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.211751 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138"} err="failed to get container status \"33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138\": rpc error: code = NotFound desc = could not find container \"33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138\": container with ID starting with 33eab1e74bed4b6eba9a049495caf0804afb03cfb63491806db4bb4990289138 not found: ID does not exist" Jun 11 23:15:05.222725 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.222698 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c644f8b-28rqk"] Jun 11 23:15:05.228396 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.228373 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65c644f8b-28rqk"] Jun 11 23:15:05.392919 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:05.392884 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" path="/var/lib/kubelet/pods/6e70b5e6-1196-4d2b-9e18-3d2648e14fdd/volumes" Jun 11 23:15:06.493033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:06.492996 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:06.593013 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:06.592982 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:07.078942 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.078908 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q"] Jun 11 23:15:07.079246 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.079235 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" containerName="console" Jun 11 23:15:07.079288 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.079248 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" containerName="console" Jun 11 23:15:07.079321 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.079305 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e70b5e6-1196-4d2b-9e18-3d2648e14fdd" containerName="console" Jun 11 23:15:07.082703 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.082685 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.085095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.085074 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:15:07.085908 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.085886 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:15:07.086004 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.085894 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6lvg8\"" Jun 11 23:15:07.092328 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.092297 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q"] Jun 11 23:15:07.172897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.172852 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vjx\" (UniqueName: \"kubernetes.io/projected/d58f2b93-3ffc-4683-8cca-7d569faac9c5-kube-api-access-z8vjx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.172897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.172899 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.173112 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.172953 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.274163 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.274122 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.274362 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.274190 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vjx\" (UniqueName: \"kubernetes.io/projected/d58f2b93-3ffc-4683-8cca-7d569faac9c5-kube-api-access-z8vjx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.274362 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.274218 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.274593 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.274563 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.274666 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.274610 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.282716 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.282690 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vjx\" (UniqueName: \"kubernetes.io/projected/d58f2b93-3ffc-4683-8cca-7d569faac9c5-kube-api-access-z8vjx\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.392706 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.392620 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:07.519210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:07.519170 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q"] Jun 11 23:15:07.521421 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:15:07.521391 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58f2b93_3ffc_4683_8cca_7d569faac9c5.slice/crio-6336c21571c783081f98ed50cf445e0969d4bac6913a2a3debf42fac77302de7 WatchSource:0}: Error finding container 6336c21571c783081f98ed50cf445e0969d4bac6913a2a3debf42fac77302de7: Status 404 returned error can't find the container with id 6336c21571c783081f98ed50cf445e0969d4bac6913a2a3debf42fac77302de7 Jun 11 23:15:08.217857 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:08.217810 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" event={"ID":"d58f2b93-3ffc-4683-8cca-7d569faac9c5","Type":"ContainerStarted","Data":"6336c21571c783081f98ed50cf445e0969d4bac6913a2a3debf42fac77302de7"} Jun 11 23:15:14.246223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:14.246185 2571 generic.go:356] "Generic (PLEG): container finished" podID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerID="449b5f90c8694c9594d44e7d4bb65dc7d970fdd771dbf6ca5576e4fd22d479a6" exitCode=0 Jun 11 23:15:14.246691 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:14.246263 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" event={"ID":"d58f2b93-3ffc-4683-8cca-7d569faac9c5","Type":"ContainerDied","Data":"449b5f90c8694c9594d44e7d4bb65dc7d970fdd771dbf6ca5576e4fd22d479a6"} Jun 11 23:15:16.257049 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:16.256961 2571 generic.go:356] "Generic (PLEG): container finished" podID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerID="9468723630c4e18e0eb9a42b2592aec569ef031333e66c4a5e69c627eff32b3a" exitCode=0 Jun 11 23:15:16.257049 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:16.257018 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" event={"ID":"d58f2b93-3ffc-4683-8cca-7d569faac9c5","Type":"ContainerDied","Data":"9468723630c4e18e0eb9a42b2592aec569ef031333e66c4a5e69c627eff32b3a"} Jun 11 23:15:23.291525 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:23.291487 2571 generic.go:356] "Generic (PLEG): container finished" podID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerID="2236e69e36353934423180a0c0925cd2d325872cf1bda8da1d555861d09cba88" exitCode=0 Jun 11 23:15:23.291908 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:23.291576 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" event={"ID":"d58f2b93-3ffc-4683-8cca-7d569faac9c5","Type":"ContainerDied","Data":"2236e69e36353934423180a0c0925cd2d325872cf1bda8da1d555861d09cba88"} Jun 11 23:15:24.429923 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.429896 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:24.534922 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.534886 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-util\") pod \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " Jun 11 23:15:24.535098 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.534982 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8vjx\" (UniqueName: \"kubernetes.io/projected/d58f2b93-3ffc-4683-8cca-7d569faac9c5-kube-api-access-z8vjx\") pod \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " Jun 11 23:15:24.535098 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.535009 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-bundle\") pod \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\" (UID: \"d58f2b93-3ffc-4683-8cca-7d569faac9c5\") " Jun 11 23:15:24.535739 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.535716 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-bundle" (OuterVolumeSpecName: "bundle") pod "d58f2b93-3ffc-4683-8cca-7d569faac9c5" (UID: "d58f2b93-3ffc-4683-8cca-7d569faac9c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:15:24.537213 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.537188 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d58f2b93-3ffc-4683-8cca-7d569faac9c5-kube-api-access-z8vjx" (OuterVolumeSpecName: "kube-api-access-z8vjx") pod "d58f2b93-3ffc-4683-8cca-7d569faac9c5" (UID: "d58f2b93-3ffc-4683-8cca-7d569faac9c5"). InnerVolumeSpecName "kube-api-access-z8vjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:15:24.539348 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.539320 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-util" (OuterVolumeSpecName: "util") pod "d58f2b93-3ffc-4683-8cca-7d569faac9c5" (UID: "d58f2b93-3ffc-4683-8cca-7d569faac9c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:15:24.635989 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.635907 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8vjx\" (UniqueName: \"kubernetes.io/projected/d58f2b93-3ffc-4683-8cca-7d569faac9c5-kube-api-access-z8vjx\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:24.635989 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.635936 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:24.635989 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:24.635946 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d58f2b93-3ffc-4683-8cca-7d569faac9c5-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:25.301644 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:25.301611 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" event={"ID":"d58f2b93-3ffc-4683-8cca-7d569faac9c5","Type":"ContainerDied","Data":"6336c21571c783081f98ed50cf445e0969d4bac6913a2a3debf42fac77302de7"} Jun 11 23:15:25.301810 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:25.301651 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlm85q" Jun 11 23:15:25.301810 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:25.301659 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6336c21571c783081f98ed50cf445e0969d4bac6913a2a3debf42fac77302de7" Jun 11 23:15:27.897740 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:27.897702 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:29.263543 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:29.263505 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:31.469418 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:31.469375 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:31.570111 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:31.570072 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:33.087095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:33.087050 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:33.187315 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:33.187284 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:33.562692 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:33.562649 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:33.687427 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:33.687397 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:34.281887 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.281849 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8"] Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282175 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="pull" Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282185 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="pull" Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282205 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="util" Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282211 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="util" Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282220 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="extract" Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282227 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="extract" Jun 11 23:15:34.282326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.282279 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d58f2b93-3ffc-4683-8cca-7d569faac9c5" containerName="extract" Jun 11 23:15:34.286083 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.286061 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.288349 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.288325 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:15:34.288454 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.288327 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6lvg8\"" Jun 11 23:15:34.288929 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.288915 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:15:34.294375 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.294347 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8"] Jun 11 23:15:34.422195 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.422159 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.422372 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.422263 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.422372 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.422329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpqw\" (UniqueName: \"kubernetes.io/projected/c9509327-da32-4285-9319-8c6801d46005-kube-api-access-dkpqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.523146 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.523102 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.523338 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.523230 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.523338 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.523266 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpqw\" (UniqueName: \"kubernetes.io/projected/c9509327-da32-4285-9319-8c6801d46005-kube-api-access-dkpqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.523562 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.523538 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.523630 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.523576 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.531944 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.531889 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpqw\" (UniqueName: \"kubernetes.io/projected/c9509327-da32-4285-9319-8c6801d46005-kube-api-access-dkpqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.595979 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.595944 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:34.729080 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:34.729056 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8"] Jun 11 23:15:34.731229 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:15:34.731198 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9509327_da32_4285_9319_8c6801d46005.slice/crio-ff4f87c93e6c6988d6f693dd339d0d14a9f1d3226af3e3f3161e2eb108c7c18a WatchSource:0}: Error finding container ff4f87c93e6c6988d6f693dd339d0d14a9f1d3226af3e3f3161e2eb108c7c18a: Status 404 returned error can't find the container with id ff4f87c93e6c6988d6f693dd339d0d14a9f1d3226af3e3f3161e2eb108c7c18a Jun 11 23:15:35.342520 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:35.342484 2571 generic.go:356] "Generic (PLEG): container finished" podID="c9509327-da32-4285-9319-8c6801d46005" containerID="eb4c5ae8471ddc9c03414627a06e1a14ef898e89493ec16fd538cb02f285948d" exitCode=0 Jun 11 23:15:35.342881 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:35.342564 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" event={"ID":"c9509327-da32-4285-9319-8c6801d46005","Type":"ContainerDied","Data":"eb4c5ae8471ddc9c03414627a06e1a14ef898e89493ec16fd538cb02f285948d"} Jun 11 23:15:35.342881 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:35.342614 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" event={"ID":"c9509327-da32-4285-9319-8c6801d46005","Type":"ContainerStarted","Data":"ff4f87c93e6c6988d6f693dd339d0d14a9f1d3226af3e3f3161e2eb108c7c18a"} Jun 11 23:15:36.395715 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:36.395672 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:36.984729 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:36.984690 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:37.358488 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:37.358392 2571 generic.go:356] "Generic (PLEG): container finished" podID="c9509327-da32-4285-9319-8c6801d46005" containerID="5ff36ab8db64e69fa0453eec531d624bfdf31dd4ad3faa02116eae8022795eb8" exitCode=0 Jun 11 23:15:37.358488 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:37.358476 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" event={"ID":"c9509327-da32-4285-9319-8c6801d46005","Type":"ContainerDied","Data":"5ff36ab8db64e69fa0453eec531d624bfdf31dd4ad3faa02116eae8022795eb8"} Jun 11 23:15:38.365338 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:38.365306 2571 generic.go:356] "Generic (PLEG): container finished" podID="c9509327-da32-4285-9319-8c6801d46005" containerID="c14af0c595f4f2720e4407f6571b41f2093eb74f7e4c3ab9234e531b2b23fbf9" exitCode=0 Jun 11 23:15:38.365734 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:38.365380 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" event={"ID":"c9509327-da32-4285-9319-8c6801d46005","Type":"ContainerDied","Data":"c14af0c595f4f2720e4407f6571b41f2093eb74f7e4c3ab9234e531b2b23fbf9"} Jun 11 23:15:38.466616 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:38.466576 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:38.524675 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:38.524636 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:39.497124 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.497095 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:39.569316 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.569275 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-util\") pod \"c9509327-da32-4285-9319-8c6801d46005\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " Jun 11 23:15:39.569510 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.569356 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkpqw\" (UniqueName: \"kubernetes.io/projected/c9509327-da32-4285-9319-8c6801d46005-kube-api-access-dkpqw\") pod \"c9509327-da32-4285-9319-8c6801d46005\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " Jun 11 23:15:39.569510 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.569418 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-bundle\") pod \"c9509327-da32-4285-9319-8c6801d46005\" (UID: \"c9509327-da32-4285-9319-8c6801d46005\") " Jun 11 23:15:39.569878 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.569848 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-bundle" (OuterVolumeSpecName: "bundle") pod "c9509327-da32-4285-9319-8c6801d46005" (UID: "c9509327-da32-4285-9319-8c6801d46005"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:15:39.571496 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.571476 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9509327-da32-4285-9319-8c6801d46005-kube-api-access-dkpqw" (OuterVolumeSpecName: "kube-api-access-dkpqw") pod "c9509327-da32-4285-9319-8c6801d46005" (UID: "c9509327-da32-4285-9319-8c6801d46005"). InnerVolumeSpecName "kube-api-access-dkpqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:15:39.574978 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.574953 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-util" (OuterVolumeSpecName: "util") pod "c9509327-da32-4285-9319-8c6801d46005" (UID: "c9509327-da32-4285-9319-8c6801d46005"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:15:39.670799 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.670687 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkpqw\" (UniqueName: \"kubernetes.io/projected/c9509327-da32-4285-9319-8c6801d46005-kube-api-access-dkpqw\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:39.670799 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.670741 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:39.670799 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:39.670754 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9509327-da32-4285-9319-8c6801d46005-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:15:40.375944 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:40.375914 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" event={"ID":"c9509327-da32-4285-9319-8c6801d46005","Type":"ContainerDied","Data":"ff4f87c93e6c6988d6f693dd339d0d14a9f1d3226af3e3f3161e2eb108c7c18a"} Jun 11 23:15:40.376157 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:40.375953 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f257x8" Jun 11 23:15:40.376157 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:40.375959 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff4f87c93e6c6988d6f693dd339d0d14a9f1d3226af3e3f3161e2eb108c7c18a" Jun 11 23:15:41.178937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.178899 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-s76tl"] Jun 11 23:15:41.179308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179233 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="extract" Jun 11 23:15:41.179308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179245 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="extract" Jun 11 23:15:41.179308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179255 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="pull" Jun 11 23:15:41.179308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179261 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="pull" Jun 11 23:15:41.179308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179271 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="util" Jun 11 23:15:41.179308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179277 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="util" Jun 11 23:15:41.179532 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.179339 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9509327-da32-4285-9319-8c6801d46005" containerName="extract" Jun 11 23:15:41.181386 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.181369 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.183583 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.183549 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 23:15:41.183721 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.183682 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l62xd\"" Jun 11 23:15:41.184398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.184380 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 23:15:41.190792 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.190763 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-s76tl"] Jun 11 23:15:41.284886 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.284818 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk7tz\" (UniqueName: \"kubernetes.io/projected/9dafbf6e-cf50-453b-a1bf-a675baa1d3ce-kube-api-access-zk7tz\") pod \"cert-manager-webhook-7dc76cbb94-s76tl\" (UID: \"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.285054 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.284928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dafbf6e-cf50-453b-a1bf-a675baa1d3ce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-s76tl\" (UID: \"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.385682 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.385644 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dafbf6e-cf50-453b-a1bf-a675baa1d3ce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-s76tl\" (UID: \"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.385881 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.385734 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk7tz\" (UniqueName: \"kubernetes.io/projected/9dafbf6e-cf50-453b-a1bf-a675baa1d3ce-kube-api-access-zk7tz\") pod \"cert-manager-webhook-7dc76cbb94-s76tl\" (UID: \"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.393690 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.393664 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk7tz\" (UniqueName: \"kubernetes.io/projected/9dafbf6e-cf50-453b-a1bf-a675baa1d3ce-kube-api-access-zk7tz\") pod \"cert-manager-webhook-7dc76cbb94-s76tl\" (UID: \"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.393862 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.393664 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dafbf6e-cf50-453b-a1bf-a675baa1d3ce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-s76tl\" (UID: \"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.491884 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.491818 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:41.621241 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:41.621212 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-s76tl"] Jun 11 23:15:41.623186 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:15:41.623159 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dafbf6e_cf50_453b_a1bf_a675baa1d3ce.slice/crio-9f092a10ad1932fe0d508ae759e2ce6add1b2c75d974389db333a4b1a2e26029 WatchSource:0}: Error finding container 9f092a10ad1932fe0d508ae759e2ce6add1b2c75d974389db333a4b1a2e26029: Status 404 returned error can't find the container with id 9f092a10ad1932fe0d508ae759e2ce6add1b2c75d974389db333a4b1a2e26029 Jun 11 23:15:42.387384 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:42.387342 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" event={"ID":"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce","Type":"ContainerStarted","Data":"9f092a10ad1932fe0d508ae759e2ce6add1b2c75d974389db333a4b1a2e26029"} Jun 11 23:15:44.007744 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:44.007651 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:44.112375 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:44.112340 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:44.397759 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:44.397671 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" event={"ID":"9dafbf6e-cf50-453b-a1bf-a675baa1d3ce","Type":"ContainerStarted","Data":"99e346cbac41c46142f5003def09f6a71618394e881a6486daefeee55f9101a8"} Jun 11 23:15:44.397759 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:44.397725 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:44.413970 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:44.413910 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" podStartSLOduration=1.286413818 podStartE2EDuration="3.413891025s" totalImagesPullingTime="2.127477207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:15:44.412323491 +0000 UTC m=+505.417761322" watchObservedRunningTime="2026-06-11 23:15:44.413891025 +0000 UTC m=+505.419328834" Jun 11 23:15:44.802413 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:44.802380 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:45.066237 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:45.066147 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:45.166958 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:45.166917 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:47.161163 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.161122 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42"] Jun 11 23:15:47.163657 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.163640 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.166119 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.166088 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b2b9d\"" Jun 11 23:15:47.166261 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.166131 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:15:47.166261 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.166141 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:15:47.173421 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.173395 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42"] Jun 11 23:15:47.234213 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.234174 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d839dcd9-0a24-45be-a5b3-aed76cfa8b36-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hkd42\" (UID: \"d839dcd9-0a24-45be-a5b3-aed76cfa8b36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.234383 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.234231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxmvx\" (UniqueName: \"kubernetes.io/projected/d839dcd9-0a24-45be-a5b3-aed76cfa8b36-kube-api-access-bxmvx\") pod \"openshift-lws-operator-fd8ccff4c-hkd42\" (UID: \"d839dcd9-0a24-45be-a5b3-aed76cfa8b36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.334835 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.334792 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d839dcd9-0a24-45be-a5b3-aed76cfa8b36-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hkd42\" (UID: \"d839dcd9-0a24-45be-a5b3-aed76cfa8b36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.334979 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.334864 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxmvx\" (UniqueName: \"kubernetes.io/projected/d839dcd9-0a24-45be-a5b3-aed76cfa8b36-kube-api-access-bxmvx\") pod \"openshift-lws-operator-fd8ccff4c-hkd42\" (UID: \"d839dcd9-0a24-45be-a5b3-aed76cfa8b36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.335193 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.335167 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d839dcd9-0a24-45be-a5b3-aed76cfa8b36-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hkd42\" (UID: \"d839dcd9-0a24-45be-a5b3-aed76cfa8b36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.342345 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.342314 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxmvx\" (UniqueName: \"kubernetes.io/projected/d839dcd9-0a24-45be-a5b3-aed76cfa8b36-kube-api-access-bxmvx\") pod \"openshift-lws-operator-fd8ccff4c-hkd42\" (UID: \"d839dcd9-0a24-45be-a5b3-aed76cfa8b36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.473876 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.473845 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" Jun 11 23:15:47.605693 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:47.605669 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42"] Jun 11 23:15:47.607787 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:15:47.607766 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd839dcd9_0a24_45be_a5b3_aed76cfa8b36.slice/crio-f15f08972c2de33deda930766de8f521767e521d11e4718c96db3d17ff906432 WatchSource:0}: Error finding container f15f08972c2de33deda930766de8f521767e521d11e4718c96db3d17ff906432: Status 404 returned error can't find the container with id f15f08972c2de33deda930766de8f521767e521d11e4718c96db3d17ff906432 Jun 11 23:15:48.416889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:48.416844 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" event={"ID":"d839dcd9-0a24-45be-a5b3-aed76cfa8b36","Type":"ContainerStarted","Data":"f15f08972c2de33deda930766de8f521767e521d11e4718c96db3d17ff906432"} Jun 11 23:15:49.424079 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:49.424044 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" event={"ID":"d839dcd9-0a24-45be-a5b3-aed76cfa8b36","Type":"ContainerStarted","Data":"59c67a06ff7841b88c430f65af10dff8927c08433ee35618c41ee30c104a93fa"} Jun 11 23:15:49.445847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:49.445243 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkd42" podStartSLOduration=0.800052166 podStartE2EDuration="2.445221871s" totalImagesPullingTime="1.645169705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:15:49.445115143 +0000 UTC m=+510.450552973" watchObservedRunningTime="2026-06-11 23:15:49.445221871 +0000 UTC m=+510.450659702" Jun 11 23:15:50.157423 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:50.157384 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:50.260684 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:50.260648 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:15:50.404556 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:50.404527 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-s76tl" Jun 11 23:15:52.227332 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:15:52.227300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:07.730316 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.730281 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd"] Jun 11 23:16:07.733107 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.733082 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.735402 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.735377 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:16:07.736333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.736313 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:16:07.736430 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.736319 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6lvg8\"" Jun 11 23:16:07.742607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.742582 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd"] Jun 11 23:16:07.817859 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.817788 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gr62\" (UniqueName: \"kubernetes.io/projected/6f23dee8-f597-4f96-9bd6-d6a6f842319e-kube-api-access-7gr62\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.818073 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.817928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.818073 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.817984 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.919235 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.919199 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gr62\" (UniqueName: \"kubernetes.io/projected/6f23dee8-f597-4f96-9bd6-d6a6f842319e-kube-api-access-7gr62\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.919413 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.919251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.919413 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.919282 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.919700 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.919678 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.919770 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.919727 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:07.928112 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:07.928086 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gr62\" (UniqueName: \"kubernetes.io/projected/6f23dee8-f597-4f96-9bd6-d6a6f842319e-kube-api-access-7gr62\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:08.042929 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:08.042804 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:08.174644 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:08.174615 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd"] Jun 11 23:16:08.177325 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:08.177293 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f23dee8_f597_4f96_9bd6_d6a6f842319e.slice/crio-d52d36ecf9642bb416e1b4470594cf276b065a9abbf5f0c5d0b1a97cd551560e WatchSource:0}: Error finding container d52d36ecf9642bb416e1b4470594cf276b065a9abbf5f0c5d0b1a97cd551560e: Status 404 returned error can't find the container with id d52d36ecf9642bb416e1b4470594cf276b065a9abbf5f0c5d0b1a97cd551560e Jun 11 23:16:08.524526 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:08.524487 2571 generic.go:356] "Generic (PLEG): container finished" podID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerID="cbd5e2f718dca7021aed392b25870a5c4c13e5d0be2436d75174ec010aba05e6" exitCode=0 Jun 11 23:16:08.524728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:08.524569 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" event={"ID":"6f23dee8-f597-4f96-9bd6-d6a6f842319e","Type":"ContainerDied","Data":"cbd5e2f718dca7021aed392b25870a5c4c13e5d0be2436d75174ec010aba05e6"} Jun 11 23:16:08.524728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:08.524644 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" event={"ID":"6f23dee8-f597-4f96-9bd6-d6a6f842319e","Type":"ContainerStarted","Data":"d52d36ecf9642bb416e1b4470594cf276b065a9abbf5f0c5d0b1a97cd551560e"} Jun 11 23:16:10.534923 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:10.534888 2571 generic.go:356] "Generic (PLEG): container finished" podID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerID="59d1763181470dc9d81af22de8b8ca7fbd54c9792be5f1b82c689efe3d096ebf" exitCode=0 Jun 11 23:16:10.535319 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:10.534947 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" event={"ID":"6f23dee8-f597-4f96-9bd6-d6a6f842319e","Type":"ContainerDied","Data":"59d1763181470dc9d81af22de8b8ca7fbd54c9792be5f1b82c689efe3d096ebf"} Jun 11 23:16:11.541099 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:11.541058 2571 generic.go:356] "Generic (PLEG): container finished" podID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerID="fcac02a66b528f27a9d239c95140ddf77c69755cd2f762b105414fadb074cb30" exitCode=0 Jun 11 23:16:11.541466 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:11.541146 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" event={"ID":"6f23dee8-f597-4f96-9bd6-d6a6f842319e","Type":"ContainerDied","Data":"fcac02a66b528f27a9d239c95140ddf77c69755cd2f762b105414fadb074cb30"} Jun 11 23:16:12.674219 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.674195 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:12.763341 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.763310 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-bundle\") pod \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " Jun 11 23:16:12.763544 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.763386 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gr62\" (UniqueName: \"kubernetes.io/projected/6f23dee8-f597-4f96-9bd6-d6a6f842319e-kube-api-access-7gr62\") pod \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " Jun 11 23:16:12.763544 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.763430 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-util\") pod \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\" (UID: \"6f23dee8-f597-4f96-9bd6-d6a6f842319e\") " Jun 11 23:16:12.764130 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.764099 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-bundle" (OuterVolumeSpecName: "bundle") pod "6f23dee8-f597-4f96-9bd6-d6a6f842319e" (UID: "6f23dee8-f597-4f96-9bd6-d6a6f842319e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:16:12.765507 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.765478 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f23dee8-f597-4f96-9bd6-d6a6f842319e-kube-api-access-7gr62" (OuterVolumeSpecName: "kube-api-access-7gr62") pod "6f23dee8-f597-4f96-9bd6-d6a6f842319e" (UID: "6f23dee8-f597-4f96-9bd6-d6a6f842319e"). InnerVolumeSpecName "kube-api-access-7gr62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:16:12.769072 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.769048 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-util" (OuterVolumeSpecName: "util") pod "6f23dee8-f597-4f96-9bd6-d6a6f842319e" (UID: "6f23dee8-f597-4f96-9bd6-d6a6f842319e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:16:12.864292 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.864182 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gr62\" (UniqueName: \"kubernetes.io/projected/6f23dee8-f597-4f96-9bd6-d6a6f842319e-kube-api-access-7gr62\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:16:12.864292 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.864233 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:16:12.864292 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:12.864247 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f23dee8-f597-4f96-9bd6-d6a6f842319e-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:16:13.552274 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:13.552239 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" event={"ID":"6f23dee8-f597-4f96-9bd6-d6a6f842319e","Type":"ContainerDied","Data":"d52d36ecf9642bb416e1b4470594cf276b065a9abbf5f0c5d0b1a97cd551560e"} Jun 11 23:16:13.552479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:13.552289 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d52d36ecf9642bb416e1b4470594cf276b065a9abbf5f0c5d0b1a97cd551560e" Jun 11 23:16:13.552479 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:13.552289 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdzkhvd" Jun 11 23:16:20.762605 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:20.762562 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:21.867623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:21.867588 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:22.762551 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:22.762514 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:22.863066 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:22.863028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:23.415542 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.415511 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:23.564066 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.564032 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:23.668191 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.668102 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:23.692232 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692199 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl"] Jun 11 23:16:23.692553 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692540 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="util" Jun 11 23:16:23.692595 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692555 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="util" Jun 11 23:16:23.692595 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692565 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="extract" Jun 11 23:16:23.692595 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692575 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="extract" Jun 11 23:16:23.692687 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692596 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="pull" Jun 11 23:16:23.692687 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692602 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="pull" Jun 11 23:16:23.692687 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.692665 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f23dee8-f597-4f96-9bd6-d6a6f842319e" containerName="extract" Jun 11 23:16:23.695488 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.695472 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.698283 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.698265 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:16:23.699424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.699219 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:16:23.699424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.699246 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:16:23.699424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.699289 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:16:23.703733 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.703714 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t7sdg\"" Jun 11 23:16:23.717760 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.717735 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl"] Jun 11 23:16:23.820725 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.820692 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:23.865792 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.865755 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea9dad07-9194-455f-8a59-31cf88d583ae-manifests\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.865969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.865805 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5kb2\" (UniqueName: \"kubernetes.io/projected/ea9dad07-9194-455f-8a59-31cf88d583ae-kube-api-access-c5kb2\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.865969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.865900 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea9dad07-9194-455f-8a59-31cf88d583ae-tmp\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.865969 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.865954 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea9dad07-9194-455f-8a59-31cf88d583ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.866120 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.865973 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea9dad07-9194-455f-8a59-31cf88d583ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.920868 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.920749 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:23.967076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.967038 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea9dad07-9194-455f-8a59-31cf88d583ae-tmp\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.967274 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.967098 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea9dad07-9194-455f-8a59-31cf88d583ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.967274 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.967127 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea9dad07-9194-455f-8a59-31cf88d583ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.967274 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.967152 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea9dad07-9194-455f-8a59-31cf88d583ae-manifests\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.967274 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.967177 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5kb2\" (UniqueName: \"kubernetes.io/projected/ea9dad07-9194-455f-8a59-31cf88d583ae-kube-api-access-c5kb2\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.967597 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.967572 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea9dad07-9194-455f-8a59-31cf88d583ae-manifests\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.969339 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.969314 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea9dad07-9194-455f-8a59-31cf88d583ae-tmp\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.969704 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.969683 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea9dad07-9194-455f-8a59-31cf88d583ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.969745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.969683 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea9dad07-9194-455f-8a59-31cf88d583ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:23.988662 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:23.988627 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5kb2\" (UniqueName: \"kubernetes.io/projected/ea9dad07-9194-455f-8a59-31cf88d583ae-kube-api-access-c5kb2\") pod \"opendatahub-operator-controller-manager-78f979bd8b-4p2dl\" (UID: \"ea9dad07-9194-455f-8a59-31cf88d583ae\") " pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:24.006401 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.006366 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:24.028337 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.028307 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:24.128761 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.128727 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:24.144935 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.144910 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl"] Jun 11 23:16:24.147157 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:24.147127 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9dad07_9194_455f_8a59_31cf88d583ae.slice/crio-6310393e82de45d21b2a42a25edd337f8f7c825d9517a859c3b04ca8f1c889c1 WatchSource:0}: Error finding container 6310393e82de45d21b2a42a25edd337f8f7c825d9517a859c3b04ca8f1c889c1: Status 404 returned error can't find the container with id 6310393e82de45d21b2a42a25edd337f8f7c825d9517a859c3b04ca8f1c889c1 Jun 11 23:16:24.228042 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.228005 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:24.330024 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.329988 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:24.437881 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.437841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:24.609523 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:24.609405 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" event={"ID":"ea9dad07-9194-455f-8a59-31cf88d583ae","Type":"ContainerStarted","Data":"6310393e82de45d21b2a42a25edd337f8f7c825d9517a859c3b04ca8f1c889c1"} Jun 11 23:16:27.627125 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:27.627091 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" event={"ID":"ea9dad07-9194-455f-8a59-31cf88d583ae","Type":"ContainerStarted","Data":"3940e98b8fcc21574db06de716fdaefe7d662d160a3d4ba15a79318dee67ba9c"} Jun 11 23:16:27.739433 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:27.739396 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:28.633210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:28.633175 2571 generic.go:356] "Generic (PLEG): container finished" podID="ea9dad07-9194-455f-8a59-31cf88d583ae" containerID="3940e98b8fcc21574db06de716fdaefe7d662d160a3d4ba15a79318dee67ba9c" exitCode=0 Jun 11 23:16:28.633608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:28.633217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" event={"ID":"ea9dad07-9194-455f-8a59-31cf88d583ae","Type":"ContainerDied","Data":"3940e98b8fcc21574db06de716fdaefe7d662d160a3d4ba15a79318dee67ba9c"} Jun 11 23:16:29.639868 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:29.639836 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" event={"ID":"ea9dad07-9194-455f-8a59-31cf88d583ae","Type":"ContainerStarted","Data":"f6d639c11650c8322de788c0de8cfb03090a796c213fd92e474186a5f600aad4"} Jun 11 23:16:29.640247 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:29.639911 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:29.662162 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:29.662111 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" podStartSLOduration=2.628461034 podStartE2EDuration="6.662094265s" totalImagesPullingTime="3.114910022s" totalInitContainerRuntime="918.723209ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:29.659712732 +0000 UTC m=+550.665150579" watchObservedRunningTime="2026-06-11 23:16:29.662094265 +0000 UTC m=+550.667532096" Jun 11 23:16:29.904767 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:29.904675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:40.646855 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:40.646813 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78f979bd8b-4p2dl" Jun 11 23:16:43.615308 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:43.615265 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:43.716131 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:43.716099 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:43.874151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:43.874048 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:43.989380 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:43.989348 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:44.094033 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.093988 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:44.173572 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.173488 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl"] Jun 11 23:16:44.175910 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.175889 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.179066 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.179036 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 23:16:44.179192 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.179079 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 23:16:44.179192 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.179098 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4wvd2\"" Jun 11 23:16:44.188004 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.187978 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl"] Jun 11 23:16:44.251911 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.251871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b433f12a-889a-4f77-b193-5378afad442f-tls-certs\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.252089 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.251923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbt47\" (UniqueName: \"kubernetes.io/projected/b433f12a-889a-4f77-b193-5378afad442f-kube-api-access-nbt47\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.252089 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.251978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b433f12a-889a-4f77-b193-5378afad442f-tmp\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.285148 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.285108 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zdlqj"] Jun 11 23:16:44.287470 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.287411 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.290345 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.290326 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 23:16:44.290563 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.290547 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-npx6d\"" Jun 11 23:16:44.309936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.309906 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zdlqj"] Jun 11 23:16:44.316546 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.316521 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:44.352543 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.352504 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b433f12a-889a-4f77-b193-5378afad442f-tls-certs\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.352728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.352555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbt47\" (UniqueName: \"kubernetes.io/projected/b433f12a-889a-4f77-b193-5378afad442f-kube-api-access-nbt47\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.352728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.352581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b433f12a-889a-4f77-b193-5378afad442f-tmp\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.352728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.352608 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0604ed36-3fcf-43fa-8e72-80199b713033-cert\") pod \"odh-model-controller-6dc94f689f-zdlqj\" (UID: \"0604ed36-3fcf-43fa-8e72-80199b713033\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.352728 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.352650 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvc55\" (UniqueName: \"kubernetes.io/projected/0604ed36-3fcf-43fa-8e72-80199b713033-kube-api-access-xvc55\") pod \"odh-model-controller-6dc94f689f-zdlqj\" (UID: \"0604ed36-3fcf-43fa-8e72-80199b713033\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.354959 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.354928 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b433f12a-889a-4f77-b193-5378afad442f-tmp\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.355081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.355060 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b433f12a-889a-4f77-b193-5378afad442f-tls-certs\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.361373 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.361337 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbt47\" (UniqueName: \"kubernetes.io/projected/b433f12a-889a-4f77-b193-5378afad442f-kube-api-access-nbt47\") pod \"kube-auth-proxy-77cd959c47-h7tbl\" (UID: \"b433f12a-889a-4f77-b193-5378afad442f\") " pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.422293 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.422260 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:44.453745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.453641 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0604ed36-3fcf-43fa-8e72-80199b713033-cert\") pod \"odh-model-controller-6dc94f689f-zdlqj\" (UID: \"0604ed36-3fcf-43fa-8e72-80199b713033\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.453745 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.453710 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvc55\" (UniqueName: \"kubernetes.io/projected/0604ed36-3fcf-43fa-8e72-80199b713033-kube-api-access-xvc55\") pod \"odh-model-controller-6dc94f689f-zdlqj\" (UID: \"0604ed36-3fcf-43fa-8e72-80199b713033\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.456159 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.456128 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0604ed36-3fcf-43fa-8e72-80199b713033-cert\") pod \"odh-model-controller-6dc94f689f-zdlqj\" (UID: \"0604ed36-3fcf-43fa-8e72-80199b713033\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.462472 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.462443 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvc55\" (UniqueName: \"kubernetes.io/projected/0604ed36-3fcf-43fa-8e72-80199b713033-kube-api-access-xvc55\") pod \"odh-model-controller-6dc94f689f-zdlqj\" (UID: \"0604ed36-3fcf-43fa-8e72-80199b713033\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.485727 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.485697 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" Jun 11 23:16:44.518328 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.518294 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:44.597115 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.597072 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:44.620029 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.619995 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl"] Jun 11 23:16:44.622215 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:44.622179 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb433f12a_889a_4f77_b193_5378afad442f.slice/crio-e36728a5d6d1e6d7212b474435a78527ad418863afb64b5d03ab94ec7645e15c WatchSource:0}: Error finding container e36728a5d6d1e6d7212b474435a78527ad418863afb64b5d03ab94ec7645e15c: Status 404 returned error can't find the container with id e36728a5d6d1e6d7212b474435a78527ad418863afb64b5d03ab94ec7645e15c Jun 11 23:16:44.717320 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.717247 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" event={"ID":"b433f12a-889a-4f77-b193-5378afad442f","Type":"ContainerStarted","Data":"e36728a5d6d1e6d7212b474435a78527ad418863afb64b5d03ab94ec7645e15c"} Jun 11 23:16:44.735634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.735608 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zdlqj"] Jun 11 23:16:44.737488 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:44.737462 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0604ed36_3fcf_43fa_8e72_80199b713033.slice/crio-21a20a11692f7eb52ad78bf421715facdf47e84bb411576998e33cb6841e5c0c WatchSource:0}: Error finding container 21a20a11692f7eb52ad78bf421715facdf47e84bb411576998e33cb6841e5c0c: Status 404 returned error can't find the container with id 21a20a11692f7eb52ad78bf421715facdf47e84bb411576998e33cb6841e5c0c Jun 11 23:16:44.947462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.947426 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hr84p"] Jun 11 23:16:44.950411 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.950394 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:44.953023 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.953002 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 23:16:44.960377 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.960352 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hr84p"] Jun 11 23:16:44.975251 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:44.975226 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:45.057785 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.057748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jls69\" (UniqueName: \"kubernetes.io/projected/4649daaa-31b6-491a-aa35-0bfcdf5668f9-kube-api-access-jls69\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.057958 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.057878 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4649daaa-31b6-491a-aa35-0bfcdf5668f9-tls-certs\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.159095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.159053 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls69\" (UniqueName: \"kubernetes.io/projected/4649daaa-31b6-491a-aa35-0bfcdf5668f9-kube-api-access-jls69\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.159287 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.159170 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4649daaa-31b6-491a-aa35-0bfcdf5668f9-tls-certs\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.159361 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:16:45.159306 2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 23:16:45.159423 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:16:45.159362 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4649daaa-31b6-491a-aa35-0bfcdf5668f9-tls-certs podName:4649daaa-31b6-491a-aa35-0bfcdf5668f9 nodeName:}" failed. No retries permitted until 2026-06-11 23:16:45.659342581 +0000 UTC m=+566.664780390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4649daaa-31b6-491a-aa35-0bfcdf5668f9-tls-certs") pod "model-serving-api-5dd488fc48-hr84p" (UID: "4649daaa-31b6-491a-aa35-0bfcdf5668f9") : secret "model-serving-api-tls" not found Jun 11 23:16:45.169768 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.169734 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jls69\" (UniqueName: \"kubernetes.io/projected/4649daaa-31b6-491a-aa35-0bfcdf5668f9-kube-api-access-jls69\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.557697 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.557571 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:45.664717 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.664674 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4649daaa-31b6-491a-aa35-0bfcdf5668f9-tls-certs\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.668445 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.668410 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4649daaa-31b6-491a-aa35-0bfcdf5668f9-tls-certs\") pod \"model-serving-api-5dd488fc48-hr84p\" (UID: \"4649daaa-31b6-491a-aa35-0bfcdf5668f9\") " pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:45.727269 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.727183 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" event={"ID":"0604ed36-3fcf-43fa-8e72-80199b713033","Type":"ContainerStarted","Data":"21a20a11692f7eb52ad78bf421715facdf47e84bb411576998e33cb6841e5c0c"} Jun 11 23:16:45.862635 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:45.862539 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:46.163049 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.162952 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx"] Jun 11 23:16:46.170116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.170058 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.172438 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.172411 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6lvg8\"" Jun 11 23:16:46.172731 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.172711 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:16:46.173227 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.173168 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:16:46.173641 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.173611 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx"] Jun 11 23:16:46.272273 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.271995 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.272273 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.272052 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.272273 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.272145 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klv2k\" (UniqueName: \"kubernetes.io/projected/40921ac7-b795-4143-9de3-83388a9ea58f-kube-api-access-klv2k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.374333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.373765 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.374333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.373897 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klv2k\" (UniqueName: \"kubernetes.io/projected/40921ac7-b795-4143-9de3-83388a9ea58f-kube-api-access-klv2k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.374333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.373967 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.374333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.374200 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.374333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.374291 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.383982 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.383953 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klv2k\" (UniqueName: \"kubernetes.io/projected/40921ac7-b795-4143-9de3-83388a9ea58f-kube-api-access-klv2k\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:46.486055 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:46.486013 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:48.721467 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.721441 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hr84p"] Jun 11 23:16:48.722992 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:48.722939 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4649daaa_31b6_491a_aa35_0bfcdf5668f9.slice/crio-89a998a7b8b6c52433679cc1221ccf209256dfac1ad168912c730b403c6a089b WatchSource:0}: Error finding container 89a998a7b8b6c52433679cc1221ccf209256dfac1ad168912c730b403c6a089b: Status 404 returned error can't find the container with id 89a998a7b8b6c52433679cc1221ccf209256dfac1ad168912c730b403c6a089b Jun 11 23:16:48.747395 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.747359 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" event={"ID":"0604ed36-3fcf-43fa-8e72-80199b713033","Type":"ContainerStarted","Data":"25062710b28103a082fd5818d4c305621a8f95f31f7f1e450f95aa2fde3d3ad9"} Jun 11 23:16:48.747538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.747504 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:48.747859 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.747837 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx"] Jun 11 23:16:48.749387 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.749336 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" event={"ID":"b433f12a-889a-4f77-b193-5378afad442f","Type":"ContainerStarted","Data":"cdd462ca43c16735eddd957626b41a5aa711abc460bd637a3672c55d61df324c"} Jun 11 23:16:48.750104 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:48.750081 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40921ac7_b795_4143_9de3_83388a9ea58f.slice/crio-c1c78686818d201d3fcc720f566402132767245f19ee1fb6feaf6339bf4d7e09 WatchSource:0}: Error finding container c1c78686818d201d3fcc720f566402132767245f19ee1fb6feaf6339bf4d7e09: Status 404 returned error can't find the container with id c1c78686818d201d3fcc720f566402132767245f19ee1fb6feaf6339bf4d7e09 Jun 11 23:16:48.750946 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.750852 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" event={"ID":"4649daaa-31b6-491a-aa35-0bfcdf5668f9","Type":"ContainerStarted","Data":"89a998a7b8b6c52433679cc1221ccf209256dfac1ad168912c730b403c6a089b"} Jun 11 23:16:48.765592 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.765537 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" podStartSLOduration=0.929326551 podStartE2EDuration="4.765516898s" totalImagesPullingTime="3.836190347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:48.762367126 +0000 UTC m=+569.767804958" watchObservedRunningTime="2026-06-11 23:16:48.765516898 +0000 UTC m=+569.770954730" Jun 11 23:16:48.780565 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:48.780508 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77cd959c47-h7tbl" podStartSLOduration=0.825002064 podStartE2EDuration="4.780492361s" totalImagesPullingTime="3.955490297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:48.779033755 +0000 UTC m=+569.784471597" watchObservedRunningTime="2026-06-11 23:16:48.780492361 +0000 UTC m=+569.785930191" Jun 11 23:16:49.758185 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:49.758149 2571 generic.go:356] "Generic (PLEG): container finished" podID="40921ac7-b795-4143-9de3-83388a9ea58f" containerID="b643b00d79d2aeadef925cb0aa81f67cd7adfee27ad0a40389f6dfb9e5c1f53c" exitCode=0 Jun 11 23:16:49.758651 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:49.758232 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" event={"ID":"40921ac7-b795-4143-9de3-83388a9ea58f","Type":"ContainerDied","Data":"b643b00d79d2aeadef925cb0aa81f67cd7adfee27ad0a40389f6dfb9e5c1f53c"} Jun 11 23:16:49.758651 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:49.758297 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" event={"ID":"40921ac7-b795-4143-9de3-83388a9ea58f","Type":"ContainerStarted","Data":"c1c78686818d201d3fcc720f566402132767245f19ee1fb6feaf6339bf4d7e09"} Jun 11 23:16:50.767914 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:50.767870 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" event={"ID":"4649daaa-31b6-491a-aa35-0bfcdf5668f9","Type":"ContainerStarted","Data":"1bef3b4cef6e1895b8ff038ea895c777c89d5cc5272650c7f0e0dc932ed6af51"} Jun 11 23:16:50.768383 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:50.767946 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:16:50.769853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:50.769806 2571 generic.go:356] "Generic (PLEG): container finished" podID="40921ac7-b795-4143-9de3-83388a9ea58f" containerID="dded122bbd460b6dfc3428bc04f029b692834e0043175a8084d74550fa07e8be" exitCode=0 Jun 11 23:16:50.769986 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:50.769857 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" event={"ID":"40921ac7-b795-4143-9de3-83388a9ea58f","Type":"ContainerDied","Data":"dded122bbd460b6dfc3428bc04f029b692834e0043175a8084d74550fa07e8be"} Jun 11 23:16:50.785084 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:50.785042 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" podStartSLOduration=5.415738043 podStartE2EDuration="6.785026799s" totalImagesPullingTime="1.369288756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:50.783313333 +0000 UTC m=+571.788751163" watchObservedRunningTime="2026-06-11 23:16:50.785026799 +0000 UTC m=+571.790464627" Jun 11 23:16:51.777183 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:51.777144 2571 generic.go:356] "Generic (PLEG): container finished" podID="40921ac7-b795-4143-9de3-83388a9ea58f" containerID="a51a1036f429a8fe28bad2b1e4a5f472b414f3b60f4032c2eca80914403fdbf5" exitCode=0 Jun 11 23:16:51.777559 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:51.777227 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" event={"ID":"40921ac7-b795-4143-9de3-83388a9ea58f","Type":"ContainerDied","Data":"a51a1036f429a8fe28bad2b1e4a5f472b414f3b60f4032c2eca80914403fdbf5"} Jun 11 23:16:52.929056 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:52.929023 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:53.041487 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.041391 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-bundle\") pod \"40921ac7-b795-4143-9de3-83388a9ea58f\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " Jun 11 23:16:53.041487 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.041441 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-util\") pod \"40921ac7-b795-4143-9de3-83388a9ea58f\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " Jun 11 23:16:53.041487 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.041473 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klv2k\" (UniqueName: \"kubernetes.io/projected/40921ac7-b795-4143-9de3-83388a9ea58f-kube-api-access-klv2k\") pod \"40921ac7-b795-4143-9de3-83388a9ea58f\" (UID: \"40921ac7-b795-4143-9de3-83388a9ea58f\") " Jun 11 23:16:53.042303 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.042273 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-bundle" (OuterVolumeSpecName: "bundle") pod "40921ac7-b795-4143-9de3-83388a9ea58f" (UID: "40921ac7-b795-4143-9de3-83388a9ea58f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:16:53.043539 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.043516 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40921ac7-b795-4143-9de3-83388a9ea58f-kube-api-access-klv2k" (OuterVolumeSpecName: "kube-api-access-klv2k") pod "40921ac7-b795-4143-9de3-83388a9ea58f" (UID: "40921ac7-b795-4143-9de3-83388a9ea58f"). InnerVolumeSpecName "kube-api-access-klv2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:16:53.047265 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.047238 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-util" (OuterVolumeSpecName: "util") pod "40921ac7-b795-4143-9de3-83388a9ea58f" (UID: "40921ac7-b795-4143-9de3-83388a9ea58f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:16:53.142847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.142795 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:16:53.142847 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.142847 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40921ac7-b795-4143-9de3-83388a9ea58f-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:16:53.143053 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.142861 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klv2k\" (UniqueName: \"kubernetes.io/projected/40921ac7-b795-4143-9de3-83388a9ea58f-kube-api-access-klv2k\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:16:53.401317 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.401228 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:53.452085 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452052 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6qfs7"] Jun 11 23:16:53.452413 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452402 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="util" Jun 11 23:16:53.452462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452415 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="util" Jun 11 23:16:53.452462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452433 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="pull" Jun 11 23:16:53.452462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452439 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="pull" Jun 11 23:16:53.452462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452453 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="extract" Jun 11 23:16:53.452462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452459 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="extract" Jun 11 23:16:53.452615 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.452531 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="40921ac7-b795-4143-9de3-83388a9ea58f" containerName="extract" Jun 11 23:16:53.454721 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.454700 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.457368 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.457344 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 23:16:53.457497 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.457423 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5wgw9\"" Jun 11 23:16:53.462250 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.462229 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q"] Jun 11 23:16:53.472134 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.471965 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6qfs7"] Jun 11 23:16:53.472134 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.472070 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.474487 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.474448 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 23:16:53.475912 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.475870 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cb6mx\"" Jun 11 23:16:53.479593 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.479568 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q"] Jun 11 23:16:53.484900 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.484861 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:53.547698 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.547655 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vcc4\" (UniqueName: \"kubernetes.io/projected/1af1c4c3-bf23-411f-b1e2-01763b6f5ebc-kube-api-access-6vcc4\") pod \"llmisvc-controller-manager-864bfd7bc9-9rq5q\" (UID: \"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.547894 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.547715 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c96ad1e7-3397-4eb8-9733-a07532e35ea0-cert\") pod \"kserve-controller-manager-69fc866d76-6qfs7\" (UID: \"c96ad1e7-3397-4eb8-9733-a07532e35ea0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.547894 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.547813 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slzpl\" (UniqueName: \"kubernetes.io/projected/c96ad1e7-3397-4eb8-9733-a07532e35ea0-kube-api-access-slzpl\") pod \"kserve-controller-manager-69fc866d76-6qfs7\" (UID: \"c96ad1e7-3397-4eb8-9733-a07532e35ea0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.547998 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.547896 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1c4c3-bf23-411f-b1e2-01763b6f5ebc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9rq5q\" (UID: \"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.617127 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.617059 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:53.648610 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.648578 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1c4c3-bf23-411f-b1e2-01763b6f5ebc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9rq5q\" (UID: \"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.648776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.648651 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vcc4\" (UniqueName: \"kubernetes.io/projected/1af1c4c3-bf23-411f-b1e2-01763b6f5ebc-kube-api-access-6vcc4\") pod \"llmisvc-controller-manager-864bfd7bc9-9rq5q\" (UID: \"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.648776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.648681 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c96ad1e7-3397-4eb8-9733-a07532e35ea0-cert\") pod \"kserve-controller-manager-69fc866d76-6qfs7\" (UID: \"c96ad1e7-3397-4eb8-9733-a07532e35ea0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.648776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.648715 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slzpl\" (UniqueName: \"kubernetes.io/projected/c96ad1e7-3397-4eb8-9733-a07532e35ea0-kube-api-access-slzpl\") pod \"kserve-controller-manager-69fc866d76-6qfs7\" (UID: \"c96ad1e7-3397-4eb8-9733-a07532e35ea0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.651079 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.651056 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1c4c3-bf23-411f-b1e2-01763b6f5ebc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9rq5q\" (UID: \"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.651177 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.651128 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c96ad1e7-3397-4eb8-9733-a07532e35ea0-cert\") pod \"kserve-controller-manager-69fc866d76-6qfs7\" (UID: \"c96ad1e7-3397-4eb8-9733-a07532e35ea0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.661702 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.661629 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slzpl\" (UniqueName: \"kubernetes.io/projected/c96ad1e7-3397-4eb8-9733-a07532e35ea0-kube-api-access-slzpl\") pod \"kserve-controller-manager-69fc866d76-6qfs7\" (UID: \"c96ad1e7-3397-4eb8-9733-a07532e35ea0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.663086 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.663063 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vcc4\" (UniqueName: \"kubernetes.io/projected/1af1c4c3-bf23-411f-b1e2-01763b6f5ebc-kube-api-access-6vcc4\") pod \"llmisvc-controller-manager-864bfd7bc9-9rq5q\" (UID: \"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.723634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.723597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:53.766761 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.766727 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:53.786022 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.785993 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:53.791485 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.791463 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" Jun 11 23:16:53.791485 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.791469 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06x98gx" event={"ID":"40921ac7-b795-4143-9de3-83388a9ea58f","Type":"ContainerDied","Data":"c1c78686818d201d3fcc720f566402132767245f19ee1fb6feaf6339bf4d7e09"} Jun 11 23:16:53.791640 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.791521 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1c78686818d201d3fcc720f566402132767245f19ee1fb6feaf6339bf4d7e09" Jun 11 23:16:53.917764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.917735 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6qfs7"] Jun 11 23:16:53.920703 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:53.920619 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96ad1e7_3397_4eb8_9733_a07532e35ea0.slice/crio-6c2fe8810823c9d26fb33fd2dcd2d734728f3982b358ba36570742520cbd74bf WatchSource:0}: Error finding container 6c2fe8810823c9d26fb33fd2dcd2d734728f3982b358ba36570742520cbd74bf: Status 404 returned error can't find the container with id 6c2fe8810823c9d26fb33fd2dcd2d734728f3982b358ba36570742520cbd74bf Jun 11 23:16:53.942098 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:53.942050 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q"] Jun 11 23:16:53.944330 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:16:53.944301 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1af1c4c3_bf23_411f_b1e2_01763b6f5ebc.slice/crio-d68bb2ba07d2380afb30a98b1c84f9354dc292c6b2161722ca1b48dade1f0e45 WatchSource:0}: Error finding container d68bb2ba07d2380afb30a98b1c84f9354dc292c6b2161722ca1b48dade1f0e45: Status 404 returned error can't find the container with id d68bb2ba07d2380afb30a98b1c84f9354dc292c6b2161722ca1b48dade1f0e45 Jun 11 23:16:54.701746 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:54.701677 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:54.798997 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:54.798959 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" event={"ID":"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc","Type":"ContainerStarted","Data":"d68bb2ba07d2380afb30a98b1c84f9354dc292c6b2161722ca1b48dade1f0e45"} Jun 11 23:16:54.800106 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:54.800081 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" event={"ID":"c96ad1e7-3397-4eb8-9733-a07532e35ea0","Type":"ContainerStarted","Data":"6c2fe8810823c9d26fb33fd2dcd2d734728f3982b358ba36570742520cbd74bf"} Jun 11 23:16:54.804894 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:54.804866 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:56.812158 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:56.812112 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" event={"ID":"c96ad1e7-3397-4eb8-9733-a07532e35ea0","Type":"ContainerStarted","Data":"02388bca87b07c98de5fccabf4c197d2910fb0da782a173df4f719f1b9168e1d"} Jun 11 23:16:56.812540 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:56.812205 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:16:56.847101 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:56.847047 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" podStartSLOduration=1.879711798 podStartE2EDuration="3.847032043s" totalImagesPullingTime="1.967320245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:56.844959973 +0000 UTC m=+577.850397796" watchObservedRunningTime="2026-06-11 23:16:56.847032043 +0000 UTC m=+577.852469873" Jun 11 23:16:57.821191 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:57.820003 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" event={"ID":"1af1c4c3-bf23-411f-b1e2-01763b6f5ebc","Type":"ContainerStarted","Data":"530ced69857ae547d8157b9d5413d6ce373ffefd29cc709c866074ed3fe487ea"} Jun 11 23:16:57.821191 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:57.820327 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:16:57.836888 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:57.836818 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" podStartSLOduration=1.944083067 podStartE2EDuration="4.836803444s" totalImagesPullingTime="2.892720377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:16:57.835792404 +0000 UTC m=+578.841230257" watchObservedRunningTime="2026-06-11 23:16:57.836803444 +0000 UTC m=+578.842241274" Jun 11 23:16:59.743369 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:59.743334 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:16:59.760721 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:59.760696 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zdlqj" Jun 11 23:16:59.916636 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:16:59.916606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:01.024248 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.024212 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67"] Jun 11 23:17:01.028424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.028393 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.037097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.037068 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:17:01.038922 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.038904 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6lvg8\"" Jun 11 23:17:01.040293 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.040273 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:17:01.055482 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.055453 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67"] Jun 11 23:17:01.088726 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.088694 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:01.121260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.121217 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.121446 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.121276 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.121446 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.121414 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67zpw\" (UniqueName: \"kubernetes.io/projected/f2ba2692-308d-482b-aae1-e1ef3a4eb266-kube-api-access-67zpw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.222622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.222576 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67zpw\" (UniqueName: \"kubernetes.io/projected/f2ba2692-308d-482b-aae1-e1ef3a4eb266-kube-api-access-67zpw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.222622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.222630 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.222902 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.222672 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.222999 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.222979 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.223039 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.223010 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.248332 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.248300 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67zpw\" (UniqueName: \"kubernetes.io/projected/f2ba2692-308d-482b-aae1-e1ef3a4eb266-kube-api-access-67zpw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.338467 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.338363 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:01.494067 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.494043 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67"] Jun 11 23:17:01.496397 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:17:01.496370 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ba2692_308d_482b_aae1_e1ef3a4eb266.slice/crio-4211b01fd9d1e7ea8c3a5b3e74129bffa1ab937aa0209a59beb0d0e0f5fb9ae5 WatchSource:0}: Error finding container 4211b01fd9d1e7ea8c3a5b3e74129bffa1ab937aa0209a59beb0d0e0f5fb9ae5: Status 404 returned error can't find the container with id 4211b01fd9d1e7ea8c3a5b3e74129bffa1ab937aa0209a59beb0d0e0f5fb9ae5 Jun 11 23:17:01.616766 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.616724 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:01.745508 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.745473 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:01.784623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.784589 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hr84p" Jun 11 23:17:01.842375 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.842335 2571 generic.go:356] "Generic (PLEG): container finished" podID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerID="93d7d5b32811b04618f3bc107b47ab46febac8e1a41381dea58762775fae3940" exitCode=0 Jun 11 23:17:01.842530 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.842438 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" event={"ID":"f2ba2692-308d-482b-aae1-e1ef3a4eb266","Type":"ContainerDied","Data":"93d7d5b32811b04618f3bc107b47ab46febac8e1a41381dea58762775fae3940"} Jun 11 23:17:01.842530 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:01.842520 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" event={"ID":"f2ba2692-308d-482b-aae1-e1ef3a4eb266","Type":"ContainerStarted","Data":"4211b01fd9d1e7ea8c3a5b3e74129bffa1ab937aa0209a59beb0d0e0f5fb9ae5"} Jun 11 23:17:02.238613 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.238576 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:02.518631 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.518545 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d"] Jun 11 23:17:02.521299 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.521281 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.523604 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.523572 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 23:17:02.523723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.523632 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 23:17:02.523723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.523674 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-5tjwc\"" Jun 11 23:17:02.537899 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.537869 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d"] Jun 11 23:17:02.539913 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.539879 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wsz\" (UniqueName: \"kubernetes.io/projected/f3efb30f-d4f4-450a-9d22-58fcedfd948a-kube-api-access-c9wsz\") pod \"servicemesh-operator3-57f65f65fb-h4b6d\" (UID: \"f3efb30f-d4f4-450a-9d22-58fcedfd948a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.540070 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.540046 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f3efb30f-d4f4-450a-9d22-58fcedfd948a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-h4b6d\" (UID: \"f3efb30f-d4f4-450a-9d22-58fcedfd948a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.640531 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.640487 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wsz\" (UniqueName: \"kubernetes.io/projected/f3efb30f-d4f4-450a-9d22-58fcedfd948a-kube-api-access-c9wsz\") pod \"servicemesh-operator3-57f65f65fb-h4b6d\" (UID: \"f3efb30f-d4f4-450a-9d22-58fcedfd948a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.640682 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.640573 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f3efb30f-d4f4-450a-9d22-58fcedfd948a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-h4b6d\" (UID: \"f3efb30f-d4f4-450a-9d22-58fcedfd948a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.643188 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.643161 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f3efb30f-d4f4-450a-9d22-58fcedfd948a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-h4b6d\" (UID: \"f3efb30f-d4f4-450a-9d22-58fcedfd948a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.651884 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.651858 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wsz\" (UniqueName: \"kubernetes.io/projected/f3efb30f-d4f4-450a-9d22-58fcedfd948a-kube-api-access-c9wsz\") pod \"servicemesh-operator3-57f65f65fb-h4b6d\" (UID: \"f3efb30f-d4f4-450a-9d22-58fcedfd948a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.830975 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.830866 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:02.979587 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:02.979563 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d"] Jun 11 23:17:02.982311 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:17:02.982280 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3efb30f_d4f4_450a_9d22_58fcedfd948a.slice/crio-ccaeed1ce76fbcb0076f7feb9f34e32008286c821a1ba7467fe0b400540b6510 WatchSource:0}: Error finding container ccaeed1ce76fbcb0076f7feb9f34e32008286c821a1ba7467fe0b400540b6510: Status 404 returned error can't find the container with id ccaeed1ce76fbcb0076f7feb9f34e32008286c821a1ba7467fe0b400540b6510 Jun 11 23:17:03.856720 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:03.856690 2571 generic.go:356] "Generic (PLEG): container finished" podID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerID="7253efd44eeaa6a1ffef56bdc76eb34cda7787188ca413782ccb22c841905906" exitCode=0 Jun 11 23:17:03.857170 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:03.856775 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" event={"ID":"f2ba2692-308d-482b-aae1-e1ef3a4eb266","Type":"ContainerDied","Data":"7253efd44eeaa6a1ffef56bdc76eb34cda7787188ca413782ccb22c841905906"} Jun 11 23:17:03.858546 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:03.858525 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" event={"ID":"f3efb30f-d4f4-450a-9d22-58fcedfd948a","Type":"ContainerStarted","Data":"ccaeed1ce76fbcb0076f7feb9f34e32008286c821a1ba7467fe0b400540b6510"} Jun 11 23:17:04.866355 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:04.866321 2571 generic.go:356] "Generic (PLEG): container finished" podID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerID="377f7682ff39987de84fa21ae45718294aa46f7d4f850f4c18d98baf32967e5a" exitCode=0 Jun 11 23:17:04.866744 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:04.866408 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" event={"ID":"f2ba2692-308d-482b-aae1-e1ef3a4eb266","Type":"ContainerDied","Data":"377f7682ff39987de84fa21ae45718294aa46f7d4f850f4c18d98baf32967e5a"} Jun 11 23:17:06.185026 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.184999 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:06.271788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.271758 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-bundle\") pod \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " Jun 11 23:17:06.271957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.271862 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67zpw\" (UniqueName: \"kubernetes.io/projected/f2ba2692-308d-482b-aae1-e1ef3a4eb266-kube-api-access-67zpw\") pod \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " Jun 11 23:17:06.271957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.271943 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-util\") pod \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\" (UID: \"f2ba2692-308d-482b-aae1-e1ef3a4eb266\") " Jun 11 23:17:06.272786 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.272756 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-bundle" (OuterVolumeSpecName: "bundle") pod "f2ba2692-308d-482b-aae1-e1ef3a4eb266" (UID: "f2ba2692-308d-482b-aae1-e1ef3a4eb266"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:17:06.273918 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.273890 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ba2692-308d-482b-aae1-e1ef3a4eb266-kube-api-access-67zpw" (OuterVolumeSpecName: "kube-api-access-67zpw") pod "f2ba2692-308d-482b-aae1-e1ef3a4eb266" (UID: "f2ba2692-308d-482b-aae1-e1ef3a4eb266"). InnerVolumeSpecName "kube-api-access-67zpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:17:06.277307 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.277285 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-util" (OuterVolumeSpecName: "util") pod "f2ba2692-308d-482b-aae1-e1ef3a4eb266" (UID: "f2ba2692-308d-482b-aae1-e1ef3a4eb266"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:17:06.372736 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.372698 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:17:06.372736 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.372728 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2ba2692-308d-482b-aae1-e1ef3a4eb266-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:17:06.372736 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.372738 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67zpw\" (UniqueName: \"kubernetes.io/projected/f2ba2692-308d-482b-aae1-e1ef3a4eb266-kube-api-access-67zpw\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:17:06.881060 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.881028 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" Jun 11 23:17:06.881060 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.881042 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahqk67" event={"ID":"f2ba2692-308d-482b-aae1-e1ef3a4eb266","Type":"ContainerDied","Data":"4211b01fd9d1e7ea8c3a5b3e74129bffa1ab937aa0209a59beb0d0e0f5fb9ae5"} Jun 11 23:17:06.881326 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.881087 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4211b01fd9d1e7ea8c3a5b3e74129bffa1ab937aa0209a59beb0d0e0f5fb9ae5" Jun 11 23:17:06.883221 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.883196 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" event={"ID":"f3efb30f-d4f4-450a-9d22-58fcedfd948a","Type":"ContainerStarted","Data":"8d703692ed03423493c066adc8cc5ba376cef4eab823e22dc1a3a2fb79043112"} Jun 11 23:17:06.883350 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.883273 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:06.907449 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:06.907400 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" podStartSLOduration=1.664899445 podStartE2EDuration="4.907383894s" totalImagesPullingTime="3.242484449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:06.905148336 +0000 UTC m=+587.910586190" watchObservedRunningTime="2026-06-11 23:17:06.907383894 +0000 UTC m=+587.912821724" Jun 11 23:17:12.492625 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:12.492588 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:12.594429 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:12.594400 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:14.469643 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.469607 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dd6984748-vvgzn"] Jun 11 23:17:14.470214 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470197 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="util" Jun 11 23:17:14.470264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470219 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="util" Jun 11 23:17:14.470264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470242 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="extract" Jun 11 23:17:14.470264 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470251 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="extract" Jun 11 23:17:14.470361 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470276 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="pull" Jun 11 23:17:14.470361 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470285 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="pull" Jun 11 23:17:14.470422 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.470369 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ba2692-308d-482b-aae1-e1ef3a4eb266" containerName="extract" Jun 11 23:17:14.473818 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.473798 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.476059 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.476035 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 23:17:14.476184 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.476108 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jbmjf\"" Jun 11 23:17:14.481609 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.481586 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dd6984748-vvgzn"] Jun 11 23:17:14.496394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.496345 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:14.544509 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.544477 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3355d20a-fd27-4382-9d63-6a322a30d172-redirect-config\") pod \"dashboard-redirect-dd6984748-vvgzn\" (UID: \"3355d20a-fd27-4382-9d63-6a322a30d172\") " pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.544509 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.544512 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blqpm\" (UniqueName: \"kubernetes.io/projected/3355d20a-fd27-4382-9d63-6a322a30d172-kube-api-access-blqpm\") pod \"dashboard-redirect-dd6984748-vvgzn\" (UID: \"3355d20a-fd27-4382-9d63-6a322a30d172\") " pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.645893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.645856 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3355d20a-fd27-4382-9d63-6a322a30d172-redirect-config\") pod \"dashboard-redirect-dd6984748-vvgzn\" (UID: \"3355d20a-fd27-4382-9d63-6a322a30d172\") " pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.646080 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.645900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blqpm\" (UniqueName: \"kubernetes.io/projected/3355d20a-fd27-4382-9d63-6a322a30d172-kube-api-access-blqpm\") pod \"dashboard-redirect-dd6984748-vvgzn\" (UID: \"3355d20a-fd27-4382-9d63-6a322a30d172\") " pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.646561 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.646541 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3355d20a-fd27-4382-9d63-6a322a30d172-redirect-config\") pod \"dashboard-redirect-dd6984748-vvgzn\" (UID: \"3355d20a-fd27-4382-9d63-6a322a30d172\") " pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.653193 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.653171 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blqpm\" (UniqueName: \"kubernetes.io/projected/3355d20a-fd27-4382-9d63-6a322a30d172-kube-api-access-blqpm\") pod \"dashboard-redirect-dd6984748-vvgzn\" (UID: \"3355d20a-fd27-4382-9d63-6a322a30d172\") " pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.785194 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.785159 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" Jun 11 23:17:14.921645 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:14.921611 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dd6984748-vvgzn"] Jun 11 23:17:14.924784 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:17:14.924742 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3355d20a_fd27_4382_9d63_6a322a30d172.slice/crio-37fe3755101bc8cfe52cc57df40d7e7cb39c257ffdff05228aad1e8963f536b1 WatchSource:0}: Error finding container 37fe3755101bc8cfe52cc57df40d7e7cb39c257ffdff05228aad1e8963f536b1: Status 404 returned error can't find the container with id 37fe3755101bc8cfe52cc57df40d7e7cb39c257ffdff05228aad1e8963f536b1 Jun 11 23:17:15.933149 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:15.933105 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" event={"ID":"3355d20a-fd27-4382-9d63-6a322a30d172","Type":"ContainerStarted","Data":"37fe3755101bc8cfe52cc57df40d7e7cb39c257ffdff05228aad1e8963f536b1"} Jun 11 23:17:16.940014 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:16.939910 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" event={"ID":"3355d20a-fd27-4382-9d63-6a322a30d172","Type":"ContainerStarted","Data":"a948e2e958fd74c47ef51712fcc72df467ba0ec512a2cbc26b4ca7bb760cebd8"} Jun 11 23:17:16.957347 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:16.957294 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dd6984748-vvgzn" podStartSLOduration=1.250254778 podStartE2EDuration="2.957276385s" totalImagesPullingTime="1.707021607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:16.954882498 +0000 UTC m=+597.960320343" watchObservedRunningTime="2026-06-11 23:17:16.957276385 +0000 UTC m=+597.962714215" Jun 11 23:17:17.891285 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:17.891252 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h4b6d" Jun 11 23:17:19.388286 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:19.388250 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:17:19.388761 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:19.388522 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:17:19.398446 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:19.398415 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:17:19.399124 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:19.399104 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:17:27.825869 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:27.825835 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6qfs7" Jun 11 23:17:29.831947 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:29.831909 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9rq5q" Jun 11 23:17:32.805992 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.805948 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f"] Jun 11 23:17:32.809502 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.809477 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.809649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.809597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:32.811681 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.811649 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:17:32.811820 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.811679 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 23:17:32.811820 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.811686 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 23:17:32.811820 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.811745 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 23:17:32.812058 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.812042 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tnmdc\"" Jun 11 23:17:32.820274 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.820241 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f"] Jun 11 23:17:32.910574 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910522 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:32.910753 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910705 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.910803 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910771 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.910879 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910806 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.910879 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910841 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.910949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910915 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54dkm\" (UniqueName: \"kubernetes.io/projected/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-kube-api-access-54dkm\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.910990 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910969 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:32.911027 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:32.910989 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012245 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012209 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012245 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012246 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012473 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012280 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54dkm\" (UniqueName: \"kubernetes.io/projected/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-kube-api-access-54dkm\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012473 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012328 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012473 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012449 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012633 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.012633 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.012607 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.013273 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.013250 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.014844 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.014800 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.015057 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.015035 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.015244 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.015225 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.015309 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.015231 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.020301 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.020277 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.021385 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.021361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54dkm\" (UniqueName: \"kubernetes.io/projected/e091f45c-e56d-4e0e-9f1c-f73f5e8b5489-kube-api-access-54dkm\") pod \"istiod-openshift-gateway-75c67f8887-nqs9f\" (UID: \"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.120371 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.120277 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:33.258198 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.258164 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f"] Jun 11 23:17:33.259889 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:17:33.259863 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode091f45c_e56d_4e0e_9f1c_f73f5e8b5489.slice/crio-1c64229be1f2fe8888fb1f0bd1d64842e5f19db9edd56b07f53787be911c459a WatchSource:0}: Error finding container 1c64229be1f2fe8888fb1f0bd1d64842e5f19db9edd56b07f53787be911c459a: Status 404 returned error can't find the container with id 1c64229be1f2fe8888fb1f0bd1d64842e5f19db9edd56b07f53787be911c459a Jun 11 23:17:33.339218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:33.339184 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:34.040141 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:34.040102 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" event={"ID":"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489","Type":"ContainerStarted","Data":"1c64229be1f2fe8888fb1f0bd1d64842e5f19db9edd56b07f53787be911c459a"} Jun 11 23:17:35.614329 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:35.614289 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 23:17:35.614606 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:35.614360 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 11 23:17:36.054072 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.054032 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" event={"ID":"e091f45c-e56d-4e0e-9f1c-f73f5e8b5489","Type":"ContainerStarted","Data":"e9d7d4579f1291f4ed4fbe77fef50ce7762b4121db31bebf6912264d19722039"} Jun 11 23:17:36.054260 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.054186 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:36.056023 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.055993 2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-nqs9f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 23:17:36.056150 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.056043 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" podUID="e091f45c-e56d-4e0e-9f1c-f73f5e8b5489" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:17:36.073774 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.073720 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" podStartSLOduration=1.721551688 podStartE2EDuration="4.07370607s" totalImagesPullingTime="2.352154382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:17:36.071813599 +0000 UTC m=+617.077251450" watchObservedRunningTime="2026-06-11 23:17:36.07370607 +0000 UTC m=+617.079143899" Jun 11 23:17:36.306340 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.306251 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:36.406784 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.406745 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:36.590354 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.590264 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:36.801925 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.801881 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:36.893357 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:36.893278 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:37.060058 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:37.060025 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nqs9f" Jun 11 23:17:37.385981 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:37.385932 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:45.158608 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:45.158564 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:45.260973 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:45.260931 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:45.357750 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:45.357713 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:46.092325 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:46.092290 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:17:46.303310 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:17:46.303273 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:00.708425 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.708389 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4"] Jun 11 23:18:00.720060 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.720034 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4"] Jun 11 23:18:00.720196 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.720128 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.722532 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.722501 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:18:00.723293 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.723267 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lptvr\"" Jun 11 23:18:00.723401 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.723353 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:18:00.774978 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.774941 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqm7j\" (UniqueName: \"kubernetes.io/projected/396af685-6d73-4674-98a9-090d8ffd58e2-kube-api-access-zqm7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.774978 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.774977 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.775203 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.775021 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.875680 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.875639 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.875858 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.875718 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqm7j\" (UniqueName: \"kubernetes.io/projected/396af685-6d73-4674-98a9-090d8ffd58e2-kube-api-access-zqm7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.875858 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.875739 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.876060 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.876042 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.876101 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.876060 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:00.885266 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:00.885233 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqm7j\" (UniqueName: \"kubernetes.io/projected/396af685-6d73-4674-98a9-090d8ffd58e2-kube-api-access-zqm7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:01.030362 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.030325 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:01.177498 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.176956 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4"] Jun 11 23:18:01.180842 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:18:01.180782 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396af685_6d73_4674_98a9_090d8ffd58e2.slice/crio-5ec465907812d161cff658166dbfb790056196fc8ff21d00c676607d04d5643c WatchSource:0}: Error finding container 5ec465907812d161cff658166dbfb790056196fc8ff21d00c676607d04d5643c: Status 404 returned error can't find the container with id 5ec465907812d161cff658166dbfb790056196fc8ff21d00c676607d04d5643c Jun 11 23:18:01.190296 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.190262 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" event={"ID":"396af685-6d73-4674-98a9-090d8ffd58e2","Type":"ContainerStarted","Data":"5ec465907812d161cff658166dbfb790056196fc8ff21d00c676607d04d5643c"} Jun 11 23:18:01.508424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.508386 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d"] Jun 11 23:18:01.512244 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.512221 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.520184 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.520148 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d"] Jun 11 23:18:01.583732 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.583641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.583895 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.583741 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-424zg\" (UniqueName: \"kubernetes.io/projected/f1ce1d71-8548-4a15-b7be-b261918c4514-kube-api-access-424zg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.583895 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.583768 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.684619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.684581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-424zg\" (UniqueName: \"kubernetes.io/projected/f1ce1d71-8548-4a15-b7be-b261918c4514-kube-api-access-424zg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.684619 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.684625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.684853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.684666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.685068 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.685051 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.685139 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.685092 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.692784 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.692762 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-424zg\" (UniqueName: \"kubernetes.io/projected/f1ce1d71-8548-4a15-b7be-b261918c4514-kube-api-access-424zg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.822596 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.822556 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:01.909708 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.909676 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl"] Jun 11 23:18:01.913972 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.913945 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:01.921635 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.921577 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl"] Jun 11 23:18:01.965046 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.965013 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d"] Jun 11 23:18:01.966757 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:18:01.966735 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ce1d71_8548_4a15_b7be_b261918c4514.slice/crio-ce8c53af1c4edd655551c6ba4be8b982699c7f271434a6bd196b99fad25dbd99 WatchSource:0}: Error finding container ce8c53af1c4edd655551c6ba4be8b982699c7f271434a6bd196b99fad25dbd99: Status 404 returned error can't find the container with id ce8c53af1c4edd655551c6ba4be8b982699c7f271434a6bd196b99fad25dbd99 Jun 11 23:18:01.987526 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.987501 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:01.987635 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.987540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:01.987700 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:01.987674 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9ldd\" (UniqueName: \"kubernetes.io/projected/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-kube-api-access-t9ldd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.088910 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.088848 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.089028 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.088972 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9ldd\" (UniqueName: \"kubernetes.io/projected/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-kube-api-access-t9ldd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.089028 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.089017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.089156 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.089136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.089324 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.089307 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.097104 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.097083 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9ldd\" (UniqueName: \"kubernetes.io/projected/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-kube-api-access-t9ldd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.196983 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.196946 2571 generic.go:356] "Generic (PLEG): container finished" podID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerID="ffaedb645afa511cfbe76cebec43ca5c8d6c76dbee65693798c8135bd42b6740" exitCode=0 Jun 11 23:18:02.197188 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.197033 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" event={"ID":"f1ce1d71-8548-4a15-b7be-b261918c4514","Type":"ContainerDied","Data":"ffaedb645afa511cfbe76cebec43ca5c8d6c76dbee65693798c8135bd42b6740"} Jun 11 23:18:02.197188 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.197106 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" event={"ID":"f1ce1d71-8548-4a15-b7be-b261918c4514","Type":"ContainerStarted","Data":"ce8c53af1c4edd655551c6ba4be8b982699c7f271434a6bd196b99fad25dbd99"} Jun 11 23:18:02.198736 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.198713 2571 generic.go:356] "Generic (PLEG): container finished" podID="396af685-6d73-4674-98a9-090d8ffd58e2" containerID="a7a424f5b2e8395d4b0d94235f1db1e24c75a346f85a74214f7e460357a8a9f5" exitCode=0 Jun 11 23:18:02.198879 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.198796 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" event={"ID":"396af685-6d73-4674-98a9-090d8ffd58e2","Type":"ContainerDied","Data":"a7a424f5b2e8395d4b0d94235f1db1e24c75a346f85a74214f7e460357a8a9f5"} Jun 11 23:18:02.225961 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.225928 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:02.366811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.366777 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl"] Jun 11 23:18:02.368471 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:18:02.368447 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b784b3_fe6f_4d1d_ae7b_b022241bde5b.slice/crio-6fa52c08d4e49c1040b7ff84965b45cd62387d495f872de81de948b659e20a53 WatchSource:0}: Error finding container 6fa52c08d4e49c1040b7ff84965b45cd62387d495f872de81de948b659e20a53: Status 404 returned error can't find the container with id 6fa52c08d4e49c1040b7ff84965b45cd62387d495f872de81de948b659e20a53 Jun 11 23:18:02.509865 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.509804 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j"] Jun 11 23:18:02.513601 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.513579 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.522059 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.522032 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j"] Jun 11 23:18:02.594151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.594104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.594319 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.594178 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.594319 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.594195 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7hn2\" (UniqueName: \"kubernetes.io/projected/f53d2792-9311-40ac-ad08-d12beab86d76-kube-api-access-q7hn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.695393 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.695364 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.695515 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.695400 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7hn2\" (UniqueName: \"kubernetes.io/projected/f53d2792-9311-40ac-ad08-d12beab86d76-kube-api-access-q7hn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.695515 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.695495 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.695811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.695789 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.695900 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.695808 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.704370 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.704346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7hn2\" (UniqueName: \"kubernetes.io/projected/f53d2792-9311-40ac-ad08-d12beab86d76-kube-api-access-q7hn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:02.843521 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:02.843489 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:03.061331 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.061300 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j"] Jun 11 23:18:03.061735 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:18:03.061710 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53d2792_9311_40ac_ad08_d12beab86d76.slice/crio-0a8a39029736ef3541dc4b72952ac73757372150109a900a94085dc6f117c087 WatchSource:0}: Error finding container 0a8a39029736ef3541dc4b72952ac73757372150109a900a94085dc6f117c087: Status 404 returned error can't find the container with id 0a8a39029736ef3541dc4b72952ac73757372150109a900a94085dc6f117c087 Jun 11 23:18:03.206270 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.206232 2571 generic.go:356] "Generic (PLEG): container finished" podID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerID="1bfb65dac8ad7a390f3a6cb435cdef80bab0243ba6a9baa6a98f49286f02dc15" exitCode=0 Jun 11 23:18:03.206500 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.206320 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" event={"ID":"f1ce1d71-8548-4a15-b7be-b261918c4514","Type":"ContainerDied","Data":"1bfb65dac8ad7a390f3a6cb435cdef80bab0243ba6a9baa6a98f49286f02dc15"} Jun 11 23:18:03.208059 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.208032 2571 generic.go:356] "Generic (PLEG): container finished" podID="f53d2792-9311-40ac-ad08-d12beab86d76" containerID="dcec47b4f4745d16516be13cd1967367bef2835b2a29c1a1f918adf1cbc9197e" exitCode=0 Jun 11 23:18:03.208146 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.208104 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" event={"ID":"f53d2792-9311-40ac-ad08-d12beab86d76","Type":"ContainerDied","Data":"dcec47b4f4745d16516be13cd1967367bef2835b2a29c1a1f918adf1cbc9197e"} Jun 11 23:18:03.208217 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.208156 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" event={"ID":"f53d2792-9311-40ac-ad08-d12beab86d76","Type":"ContainerStarted","Data":"0a8a39029736ef3541dc4b72952ac73757372150109a900a94085dc6f117c087"} Jun 11 23:18:03.210138 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.210116 2571 generic.go:356] "Generic (PLEG): container finished" podID="396af685-6d73-4674-98a9-090d8ffd58e2" containerID="ab19f4b83a2651f0377a6120199b07e931f858a5dc2b2964b5ec7df34b2d1a13" exitCode=0 Jun 11 23:18:03.210216 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.210196 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" event={"ID":"396af685-6d73-4674-98a9-090d8ffd58e2","Type":"ContainerDied","Data":"ab19f4b83a2651f0377a6120199b07e931f858a5dc2b2964b5ec7df34b2d1a13"} Jun 11 23:18:03.211912 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.211893 2571 generic.go:356] "Generic (PLEG): container finished" podID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerID="b3995394288ee00bee30614871e753d6c64536a76442261913a50ae489f49f8a" exitCode=0 Jun 11 23:18:03.212024 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.211993 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" event={"ID":"78b784b3-fe6f-4d1d-ae7b-b022241bde5b","Type":"ContainerDied","Data":"b3995394288ee00bee30614871e753d6c64536a76442261913a50ae489f49f8a"} Jun 11 23:18:03.212075 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:03.212035 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" event={"ID":"78b784b3-fe6f-4d1d-ae7b-b022241bde5b","Type":"ContainerStarted","Data":"6fa52c08d4e49c1040b7ff84965b45cd62387d495f872de81de948b659e20a53"} Jun 11 23:18:04.223522 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.223489 2571 generic.go:356] "Generic (PLEG): container finished" podID="396af685-6d73-4674-98a9-090d8ffd58e2" containerID="3e57ce58b29928cf07466346406d878b8ac87914c49651f3e739d45af6225cb2" exitCode=0 Jun 11 23:18:04.223936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.223524 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" event={"ID":"396af685-6d73-4674-98a9-090d8ffd58e2","Type":"ContainerDied","Data":"3e57ce58b29928cf07466346406d878b8ac87914c49651f3e739d45af6225cb2"} Jun 11 23:18:04.225201 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.225179 2571 generic.go:356] "Generic (PLEG): container finished" podID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerID="aadfbafa1812bd86a3d66e3f20c50c7205d9614aae202eb0a43a1efbcfca5245" exitCode=0 Jun 11 23:18:04.225310 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.225242 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" event={"ID":"78b784b3-fe6f-4d1d-ae7b-b022241bde5b","Type":"ContainerDied","Data":"aadfbafa1812bd86a3d66e3f20c50c7205d9614aae202eb0a43a1efbcfca5245"} Jun 11 23:18:04.227360 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.227341 2571 generic.go:356] "Generic (PLEG): container finished" podID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerID="da66fa3ec06d73be52fc1da4e84888641772d50542a6e6c0bc9d4273135909bb" exitCode=0 Jun 11 23:18:04.227474 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.227400 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" event={"ID":"f1ce1d71-8548-4a15-b7be-b261918c4514","Type":"ContainerDied","Data":"da66fa3ec06d73be52fc1da4e84888641772d50542a6e6c0bc9d4273135909bb"} Jun 11 23:18:04.229143 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.229125 2571 generic.go:356] "Generic (PLEG): container finished" podID="f53d2792-9311-40ac-ad08-d12beab86d76" containerID="6f8e5d2db846a8fbe1fa61078aa8dc690cc3c7078560ef5014ecb2477ef00c67" exitCode=0 Jun 11 23:18:04.229223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:04.229152 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" event={"ID":"f53d2792-9311-40ac-ad08-d12beab86d76","Type":"ContainerDied","Data":"6f8e5d2db846a8fbe1fa61078aa8dc690cc3c7078560ef5014ecb2477ef00c67"} Jun 11 23:18:05.237500 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.237467 2571 generic.go:356] "Generic (PLEG): container finished" podID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerID="1b69981afa6a8e44173914ad9bcb1589c501afcc9554f6c656f0d828ecf39e21" exitCode=0 Jun 11 23:18:05.237964 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.237552 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" event={"ID":"78b784b3-fe6f-4d1d-ae7b-b022241bde5b","Type":"ContainerDied","Data":"1b69981afa6a8e44173914ad9bcb1589c501afcc9554f6c656f0d828ecf39e21"} Jun 11 23:18:05.239613 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.239591 2571 generic.go:356] "Generic (PLEG): container finished" podID="f53d2792-9311-40ac-ad08-d12beab86d76" containerID="3ea236dbb125024357a4813bf1407e384f2bedb90e4f8fb108f4e1da2c728cfe" exitCode=0 Jun 11 23:18:05.239731 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.239656 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" event={"ID":"f53d2792-9311-40ac-ad08-d12beab86d76","Type":"ContainerDied","Data":"3ea236dbb125024357a4813bf1407e384f2bedb90e4f8fb108f4e1da2c728cfe"} Jun 11 23:18:05.384184 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.384155 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:05.421642 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.421614 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:05.424591 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.424569 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-bundle\") pod \"396af685-6d73-4674-98a9-090d8ffd58e2\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " Jun 11 23:18:05.424694 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.424614 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqm7j\" (UniqueName: \"kubernetes.io/projected/396af685-6d73-4674-98a9-090d8ffd58e2-kube-api-access-zqm7j\") pod \"396af685-6d73-4674-98a9-090d8ffd58e2\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " Jun 11 23:18:05.424694 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.424678 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-util\") pod \"396af685-6d73-4674-98a9-090d8ffd58e2\" (UID: \"396af685-6d73-4674-98a9-090d8ffd58e2\") " Jun 11 23:18:05.425052 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.425030 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-bundle" (OuterVolumeSpecName: "bundle") pod "396af685-6d73-4674-98a9-090d8ffd58e2" (UID: "396af685-6d73-4674-98a9-090d8ffd58e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:05.426982 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.426953 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396af685-6d73-4674-98a9-090d8ffd58e2-kube-api-access-zqm7j" (OuterVolumeSpecName: "kube-api-access-zqm7j") pod "396af685-6d73-4674-98a9-090d8ffd58e2" (UID: "396af685-6d73-4674-98a9-090d8ffd58e2"). InnerVolumeSpecName "kube-api-access-zqm7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:05.430062 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.430028 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-util" (OuterVolumeSpecName: "util") pod "396af685-6d73-4674-98a9-090d8ffd58e2" (UID: "396af685-6d73-4674-98a9-090d8ffd58e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:05.525995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.525890 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-bundle\") pod \"f1ce1d71-8548-4a15-b7be-b261918c4514\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " Jun 11 23:18:05.525995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.525935 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-424zg\" (UniqueName: \"kubernetes.io/projected/f1ce1d71-8548-4a15-b7be-b261918c4514-kube-api-access-424zg\") pod \"f1ce1d71-8548-4a15-b7be-b261918c4514\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " Jun 11 23:18:05.525995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.525951 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-util\") pod \"f1ce1d71-8548-4a15-b7be-b261918c4514\" (UID: \"f1ce1d71-8548-4a15-b7be-b261918c4514\") " Jun 11 23:18:05.526284 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.526127 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqm7j\" (UniqueName: \"kubernetes.io/projected/396af685-6d73-4674-98a9-090d8ffd58e2-kube-api-access-zqm7j\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:05.526284 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.526137 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:05.526284 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.526147 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/396af685-6d73-4674-98a9-090d8ffd58e2-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:05.526417 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.526353 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-bundle" (OuterVolumeSpecName: "bundle") pod "f1ce1d71-8548-4a15-b7be-b261918c4514" (UID: "f1ce1d71-8548-4a15-b7be-b261918c4514"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:05.528164 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.528138 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ce1d71-8548-4a15-b7be-b261918c4514-kube-api-access-424zg" (OuterVolumeSpecName: "kube-api-access-424zg") pod "f1ce1d71-8548-4a15-b7be-b261918c4514" (UID: "f1ce1d71-8548-4a15-b7be-b261918c4514"). InnerVolumeSpecName "kube-api-access-424zg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:05.531269 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.531234 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-util" (OuterVolumeSpecName: "util") pod "f1ce1d71-8548-4a15-b7be-b261918c4514" (UID: "f1ce1d71-8548-4a15-b7be-b261918c4514"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:05.626806 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.626767 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:05.626806 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.626802 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-424zg\" (UniqueName: \"kubernetes.io/projected/f1ce1d71-8548-4a15-b7be-b261918c4514-kube-api-access-424zg\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:05.626806 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:05.626812 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1ce1d71-8548-4a15-b7be-b261918c4514-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:06.247911 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.247870 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" event={"ID":"396af685-6d73-4674-98a9-090d8ffd58e2","Type":"ContainerDied","Data":"5ec465907812d161cff658166dbfb790056196fc8ff21d00c676607d04d5643c"} Jun 11 23:18:06.248317 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.247948 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ec465907812d161cff658166dbfb790056196fc8ff21d00c676607d04d5643c" Jun 11 23:18:06.248317 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.247887 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4" Jun 11 23:18:06.249885 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.249852 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" event={"ID":"f1ce1d71-8548-4a15-b7be-b261918c4514","Type":"ContainerDied","Data":"ce8c53af1c4edd655551c6ba4be8b982699c7f271434a6bd196b99fad25dbd99"} Jun 11 23:18:06.249885 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.249879 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d" Jun 11 23:18:06.250054 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.249905 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce8c53af1c4edd655551c6ba4be8b982699c7f271434a6bd196b99fad25dbd99" Jun 11 23:18:06.413780 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.413756 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:06.415975 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.415956 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:06.435306 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.435275 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-util\") pod \"f53d2792-9311-40ac-ad08-d12beab86d76\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " Jun 11 23:18:06.435453 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.435359 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7hn2\" (UniqueName: \"kubernetes.io/projected/f53d2792-9311-40ac-ad08-d12beab86d76-kube-api-access-q7hn2\") pod \"f53d2792-9311-40ac-ad08-d12beab86d76\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " Jun 11 23:18:06.435453 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.435404 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-bundle\") pod \"f53d2792-9311-40ac-ad08-d12beab86d76\" (UID: \"f53d2792-9311-40ac-ad08-d12beab86d76\") " Jun 11 23:18:06.436511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.436482 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-bundle" (OuterVolumeSpecName: "bundle") pod "f53d2792-9311-40ac-ad08-d12beab86d76" (UID: "f53d2792-9311-40ac-ad08-d12beab86d76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:06.437905 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.437872 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53d2792-9311-40ac-ad08-d12beab86d76-kube-api-access-q7hn2" (OuterVolumeSpecName: "kube-api-access-q7hn2") pod "f53d2792-9311-40ac-ad08-d12beab86d76" (UID: "f53d2792-9311-40ac-ad08-d12beab86d76"). InnerVolumeSpecName "kube-api-access-q7hn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:06.441518 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.441495 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-util" (OuterVolumeSpecName: "util") pod "f53d2792-9311-40ac-ad08-d12beab86d76" (UID: "f53d2792-9311-40ac-ad08-d12beab86d76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:06.536400 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.536300 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-util\") pod \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " Jun 11 23:18:06.536561 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.536434 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9ldd\" (UniqueName: \"kubernetes.io/projected/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-kube-api-access-t9ldd\") pod \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " Jun 11 23:18:06.536561 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.536490 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-bundle\") pod \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\" (UID: \"78b784b3-fe6f-4d1d-ae7b-b022241bde5b\") " Jun 11 23:18:06.536764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.536746 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:06.536853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.536768 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7hn2\" (UniqueName: \"kubernetes.io/projected/f53d2792-9311-40ac-ad08-d12beab86d76-kube-api-access-q7hn2\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:06.536853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.536782 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53d2792-9311-40ac-ad08-d12beab86d76-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:06.537155 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.537123 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-bundle" (OuterVolumeSpecName: "bundle") pod "78b784b3-fe6f-4d1d-ae7b-b022241bde5b" (UID: "78b784b3-fe6f-4d1d-ae7b-b022241bde5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:06.538620 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.538592 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-kube-api-access-t9ldd" (OuterVolumeSpecName: "kube-api-access-t9ldd") pod "78b784b3-fe6f-4d1d-ae7b-b022241bde5b" (UID: "78b784b3-fe6f-4d1d-ae7b-b022241bde5b"). InnerVolumeSpecName "kube-api-access-t9ldd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:06.541768 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.541726 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-util" (OuterVolumeSpecName: "util") pod "78b784b3-fe6f-4d1d-ae7b-b022241bde5b" (UID: "78b784b3-fe6f-4d1d-ae7b-b022241bde5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:18:06.637401 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.637369 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:06.637401 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.637397 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9ldd\" (UniqueName: \"kubernetes.io/projected/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-kube-api-access-t9ldd\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:06.637401 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:06.637409 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78b784b3-fe6f-4d1d-ae7b-b022241bde5b-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:07.257386 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:07.257357 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" Jun 11 23:18:07.257808 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:07.257446 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl" event={"ID":"78b784b3-fe6f-4d1d-ae7b-b022241bde5b","Type":"ContainerDied","Data":"6fa52c08d4e49c1040b7ff84965b45cd62387d495f872de81de948b659e20a53"} Jun 11 23:18:07.257808 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:07.257501 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fa52c08d4e49c1040b7ff84965b45cd62387d495f872de81de948b659e20a53" Jun 11 23:18:07.259363 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:07.259335 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" event={"ID":"f53d2792-9311-40ac-ad08-d12beab86d76","Type":"ContainerDied","Data":"0a8a39029736ef3541dc4b72952ac73757372150109a900a94085dc6f117c087"} Jun 11 23:18:07.259363 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:07.259355 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j" Jun 11 23:18:07.259551 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:07.259372 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a8a39029736ef3541dc4b72952ac73757372150109a900a94085dc6f117c087" Jun 11 23:18:08.764512 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:08.764466 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:11.470623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.470570 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:11.673870 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.673815 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ddf4b7bf-49db2"] Jun 11 23:18:11.674438 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.674412 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="util" Jun 11 23:18:11.674607 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.674593 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="util" Jun 11 23:18:11.674714 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.674703 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="util" Jun 11 23:18:11.674803 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.674794 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="util" Jun 11 23:18:11.674915 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.674903 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="util" Jun 11 23:18:11.675015 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675006 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="util" Jun 11 23:18:11.675109 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675098 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="pull" Jun 11 23:18:11.675191 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675183 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="pull" Jun 11 23:18:11.675273 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675264 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="extract" Jun 11 23:18:11.675346 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675338 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="extract" Jun 11 23:18:11.675424 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675415 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="pull" Jun 11 23:18:11.675498 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675489 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="pull" Jun 11 23:18:11.675574 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675564 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="pull" Jun 11 23:18:11.675645 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675637 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="pull" Jun 11 23:18:11.675726 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675715 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="util" Jun 11 23:18:11.675807 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675797 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="util" Jun 11 23:18:11.675921 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.675908 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="pull" Jun 11 23:18:11.676012 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676002 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="pull" Jun 11 23:18:11.676094 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676083 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="extract" Jun 11 23:18:11.676168 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676158 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="extract" Jun 11 23:18:11.676248 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676238 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="extract" Jun 11 23:18:11.676320 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676312 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="extract" Jun 11 23:18:11.676403 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676392 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="extract" Jun 11 23:18:11.676483 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676474 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="extract" Jun 11 23:18:11.676669 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676658 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b784b3-fe6f-4d1d-ae7b-b022241bde5b" containerName="extract" Jun 11 23:18:11.676759 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676750 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53d2792-9311-40ac-ad08-d12beab86d76" containerName="extract" Jun 11 23:18:11.676861 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676850 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1ce1d71-8548-4a15-b7be-b261918c4514" containerName="extract" Jun 11 23:18:11.676947 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.676938 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="396af685-6d73-4674-98a9-090d8ffd58e2" containerName="extract" Jun 11 23:18:11.680345 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.680322 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.690333 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.690304 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddf4b7bf-49db2"] Jun 11 23:18:11.736683 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.736594 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:11.787117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787083 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-serving-cert\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.787117 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787121 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-trusted-ca-bundle\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.787359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787137 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97svk\" (UniqueName: \"kubernetes.io/projected/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-kube-api-access-97svk\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.787359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787241 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-service-ca\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.787359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-oauth-serving-cert\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.787359 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787354 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-config\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.787508 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.787406 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-oauth-config\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.838578 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.838546 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:11.888871 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.888806 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-serving-cert\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889051 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.888878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-trusted-ca-bundle\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889051 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.888904 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97svk\" (UniqueName: \"kubernetes.io/projected/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-kube-api-access-97svk\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889051 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.888943 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-service-ca\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889051 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.888981 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-oauth-serving-cert\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889255 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.889135 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-config\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889255 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.889235 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-oauth-config\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889753 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.889718 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-service-ca\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889899 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.889820 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-config\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889899 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.889857 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-trusted-ca-bundle\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.889899 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.889874 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-oauth-serving-cert\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.891519 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.891496 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-oauth-config\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.891602 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.891563 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-console-serving-cert\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.897530 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.897503 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97svk\" (UniqueName: \"kubernetes.io/projected/e6999196-91b6-48f9-aa07-e9ad1d8ed98b-kube-api-access-97svk\") pod \"console-7ddf4b7bf-49db2\" (UID: \"e6999196-91b6-48f9-aa07-e9ad1d8ed98b\") " pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:11.938613 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.938572 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:11.991898 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:11.991795 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:12.136418 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:12.136389 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddf4b7bf-49db2"] Jun 11 23:18:12.138076 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:18:12.138038 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6999196_91b6_48f9_aa07_e9ad1d8ed98b.slice/crio-7cb894d53cf8654055f62b4863f58b3f3c1c1a7aa1c34a2c1886143b65b6d715 WatchSource:0}: Error finding container 7cb894d53cf8654055f62b4863f58b3f3c1c1a7aa1c34a2c1886143b65b6d715: Status 404 returned error can't find the container with id 7cb894d53cf8654055f62b4863f58b3f3c1c1a7aa1c34a2c1886143b65b6d715 Jun 11 23:18:12.268634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:12.268552 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:12.292770 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:12.292735 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf4b7bf-49db2" event={"ID":"e6999196-91b6-48f9-aa07-e9ad1d8ed98b","Type":"ContainerStarted","Data":"dd3fdd9a0c5cd34a6cc2dc95cc3c0f0bed3bccf383ef7f4a9a021d1f57a59866"} Jun 11 23:18:12.292946 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:12.292784 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf4b7bf-49db2" event={"ID":"e6999196-91b6-48f9-aa07-e9ad1d8ed98b","Type":"ContainerStarted","Data":"7cb894d53cf8654055f62b4863f58b3f3c1c1a7aa1c34a2c1886143b65b6d715"} Jun 11 23:18:12.327764 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:12.327709 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ddf4b7bf-49db2" podStartSLOduration=1.327691019 podStartE2EDuration="1.327691019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:12.326208534 +0000 UTC m=+653.331646364" watchObservedRunningTime="2026-06-11 23:18:12.327691019 +0000 UTC m=+653.333128848" Jun 11 23:18:12.474014 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:12.473973 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:13.760444 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:13.760403 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:14.159048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:14.158957 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:15.223063 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:15.223026 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:16.172766 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.172728 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4znvp"] Jun 11 23:18:16.176502 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.176484 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:16.178907 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.178880 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:18:16.179713 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.179696 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:18:16.179792 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.179740 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5vfdz\"" Jun 11 23:18:16.188692 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.188665 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4znvp"] Jun 11 23:18:16.228539 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.228504 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2tw\" (UniqueName: \"kubernetes.io/projected/8e47a166-229b-44a8-a1d6-d0b274d38671-kube-api-access-4z2tw\") pod \"authorino-operator-75cc8d5cb7-4znvp\" (UID: \"8e47a166-229b-44a8-a1d6-d0b274d38671\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:16.329288 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.329252 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2tw\" (UniqueName: \"kubernetes.io/projected/8e47a166-229b-44a8-a1d6-d0b274d38671-kube-api-access-4z2tw\") pod \"authorino-operator-75cc8d5cb7-4znvp\" (UID: \"8e47a166-229b-44a8-a1d6-d0b274d38671\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:16.339020 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.338991 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2tw\" (UniqueName: \"kubernetes.io/projected/8e47a166-229b-44a8-a1d6-d0b274d38671-kube-api-access-4z2tw\") pod \"authorino-operator-75cc8d5cb7-4znvp\" (UID: \"8e47a166-229b-44a8-a1d6-d0b274d38671\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:16.488093 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.488055 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:16.640538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.640499 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4znvp"] Jun 11 23:18:16.642735 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:18:16.642700 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e47a166_229b_44a8_a1d6_d0b274d38671.slice/crio-aa81540a9ec42b67a5b9b3eed9c55622ed9ea428fd6ce6c4e032dbb7c0a830db WatchSource:0}: Error finding container aa81540a9ec42b67a5b9b3eed9c55622ed9ea428fd6ce6c4e032dbb7c0a830db: Status 404 returned error can't find the container with id aa81540a9ec42b67a5b9b3eed9c55622ed9ea428fd6ce6c4e032dbb7c0a830db Jun 11 23:18:16.645565 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.645546 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:18:16.801652 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.801539 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:16.915983 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:16.915940 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:17.325558 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:17.325511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" event={"ID":"8e47a166-229b-44a8-a1d6-d0b274d38671","Type":"ContainerStarted","Data":"aa81540a9ec42b67a5b9b3eed9c55622ed9ea428fd6ce6c4e032dbb7c0a830db"} Jun 11 23:18:18.963398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:18.963305 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:19.340290 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:19.340253 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" event={"ID":"8e47a166-229b-44a8-a1d6-d0b274d38671","Type":"ContainerStarted","Data":"714d5945217bc229baff6657ee3445d6f2b016f8feb3e52a336190ce29d9f9fe"} Jun 11 23:18:19.340471 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:19.340357 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:19.364046 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:19.363972 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" podStartSLOduration=1.313079883 podStartE2EDuration="3.363955445s" totalImagesPullingTime="2.050875562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:18:19.361650286 +0000 UTC m=+660.367088138" watchObservedRunningTime="2026-06-11 23:18:19.363955445 +0000 UTC m=+660.369393274" Jun 11 23:18:20.815276 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:20.815239 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:21.129796 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:21.129673 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:21.843723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:21.843683 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:21.992472 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:21.992434 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:21.992673 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:21.992494 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:21.997597 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:21.997574 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:22.362874 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.362844 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ddf4b7bf-49db2" Jun 11 23:18:22.418069 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.418030 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf45d5786-pmnh2"] Jun 11 23:18:22.522441 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.522395 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:22.621732 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.621645 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:22.722671 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.722632 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:22.822740 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.822691 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:22.923189 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:22.923088 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:30.348985 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:30.348950 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4znvp" Jun 11 23:18:30.755815 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:30.755779 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:30.860465 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:30.860421 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:31.903243 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:31.903201 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:32.049976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:32.049931 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:32.121961 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:32.121923 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:34.380111 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:34.380072 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:34.495225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:34.495184 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:37.938603 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:37.938550 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:38.991691 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:38.991645 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:39.091105 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:39.091067 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:42.779715 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:42.779675 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:42.841491 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:42.841454 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:47.447622 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.447572 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cf45d5786-pmnh2" podUID="c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" containerName="console" containerID="cri-o://035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8" gracePeriod=15 Jun 11 23:18:47.694500 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.694472 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:18:47.721366 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721336 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-config\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721374 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-service-ca\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721410 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-trusted-ca-bundle\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721448 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b6tg\" (UniqueName: \"kubernetes.io/projected/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-kube-api-access-4b6tg\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721480 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-serving-cert\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721538 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721529 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-oauth-serving-cert\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721788 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721567 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-oauth-config\") pod \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\" (UID: \"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973\") " Jun 11 23:18:47.721929 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721782 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-config" (OuterVolumeSpecName: "console-config") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:18:47.721995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.721903 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:18:47.722323 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.722293 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:18:47.722323 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.722298 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:18:47.724038 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.724008 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:18:47.724431 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.724402 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:18:47.724506 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.724431 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-kube-api-access-4b6tg" (OuterVolumeSpecName: "kube-api-access-4b6tg") pod "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" (UID: "c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973"). InnerVolumeSpecName "kube-api-access-4b6tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:18:47.823223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823185 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.823223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823218 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-service-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.823223 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823227 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.823534 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823241 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6tg\" (UniqueName: \"kubernetes.io/projected/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-kube-api-access-4b6tg\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.823534 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823255 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.823534 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823263 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-oauth-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:47.823534 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:47.823271 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973-console-oauth-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:18:48.520606 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.520568 2571 generic.go:356] "Generic (PLEG): container finished" podID="c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" containerID="035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8" exitCode=0 Jun 11 23:18:48.521113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.520618 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf45d5786-pmnh2" event={"ID":"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973","Type":"ContainerDied","Data":"035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8"} Jun 11 23:18:48.521113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.520622 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf45d5786-pmnh2" Jun 11 23:18:48.521113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.520663 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf45d5786-pmnh2" event={"ID":"c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973","Type":"ContainerDied","Data":"52406ad72513a330cf7a9ce811e1814cf1b93aa0cec8d4e961ca277fa192fbf5"} Jun 11 23:18:48.521113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.520684 2571 scope.go:117] "RemoveContainer" containerID="035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8" Jun 11 23:18:48.530895 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.530878 2571 scope.go:117] "RemoveContainer" containerID="035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8" Jun 11 23:18:48.531163 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:18:48.531145 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8\": container with ID starting with 035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8 not found: ID does not exist" containerID="035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8" Jun 11 23:18:48.531210 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.531170 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8"} err="failed to get container status \"035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8\": rpc error: code = NotFound desc = could not find container \"035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8\": container with ID starting with 035b6ce4ede8b587be35bcba94fff78fc0f1cee3dfdddf421aed3342913c2dd8 not found: ID does not exist" Jun 11 23:18:48.544794 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.544767 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf45d5786-pmnh2"] Jun 11 23:18:48.549258 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:48.549235 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf45d5786-pmnh2"] Jun 11 23:18:49.394325 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:49.394293 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" path="/var/lib/kubelet/pods/c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973/volumes" Jun 11 23:18:51.493120 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:51.493082 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:51.592697 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:51.592664 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:51.656222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:51.656186 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:53.960625 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:53.960586 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:54.060569 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:54.060539 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:58.704705 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:58.704669 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:18:58.805583 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:18:58.805547 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:02.901606 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:02.901570 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:02.964387 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:02.964357 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:11.914283 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:11.914186 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:12.014076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:12.014039 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:12.523779 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:12.523743 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:12.654805 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:12.654764 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:14.362113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:14.362078 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:14.417280 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:14.417241 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:17.639182 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.639139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:17.647470 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.647442 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:17.647858 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.647843 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" containerName="console" Jun 11 23:19:17.647912 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.647859 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" containerName="console" Jun 11 23:19:17.647948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.647941 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9fe4db7-7c24-4bf4-bb05-fc2ad6dc1973" containerName="console" Jun 11 23:19:17.652441 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.652413 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.656410 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.656112 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lptvr\"" Jun 11 23:19:17.656811 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.656787 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 23:19:17.679026 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.678997 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:17.719310 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.719277 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:17.736476 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.736444 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:17.790066 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.790018 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:17.808007 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.807972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfzct\" (UniqueName: \"kubernetes.io/projected/4ea483ed-569b-4007-8489-c54b49ba7e98-kube-api-access-gfzct\") pod \"limitador-limitador-64c94fd64f-c7kgv\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.808133 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.808010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ea483ed-569b-4007-8489-c54b49ba7e98-config-file\") pod \"limitador-limitador-64c94fd64f-c7kgv\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.909048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.908965 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzct\" (UniqueName: \"kubernetes.io/projected/4ea483ed-569b-4007-8489-c54b49ba7e98-kube-api-access-gfzct\") pod \"limitador-limitador-64c94fd64f-c7kgv\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.909048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.909002 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ea483ed-569b-4007-8489-c54b49ba7e98-config-file\") pod \"limitador-limitador-64c94fd64f-c7kgv\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.909658 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.909639 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ea483ed-569b-4007-8489-c54b49ba7e98-config-file\") pod \"limitador-limitador-64c94fd64f-c7kgv\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.918820 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.918788 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfzct\" (UniqueName: \"kubernetes.io/projected/4ea483ed-569b-4007-8489-c54b49ba7e98-kube-api-access-gfzct\") pod \"limitador-limitador-64c94fd64f-c7kgv\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:17.965313 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:17.965272 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:18.105292 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:18.105230 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:18.107786 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:19:18.107748 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea483ed_569b_4007_8489_c54b49ba7e98.slice/crio-a288664ce6f08c028b538cebaa2391f4a7790d19096006f5003c184a9abf5777 WatchSource:0}: Error finding container a288664ce6f08c028b538cebaa2391f4a7790d19096006f5003c184a9abf5777: Status 404 returned error can't find the container with id a288664ce6f08c028b538cebaa2391f4a7790d19096006f5003c184a9abf5777 Jun 11 23:19:18.445081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:18.445035 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:18.548460 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:18.548401 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:18.703328 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:18.703232 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" event={"ID":"4ea483ed-569b-4007-8489-c54b49ba7e98","Type":"ContainerStarted","Data":"a288664ce6f08c028b538cebaa2391f4a7790d19096006f5003c184a9abf5777"} Jun 11 23:19:19.117330 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:19.117278 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:19.216748 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:19.216712 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:21.727342 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:21.727307 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" event={"ID":"4ea483ed-569b-4007-8489-c54b49ba7e98","Type":"ContainerStarted","Data":"3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9"} Jun 11 23:19:21.727727 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:21.727373 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:21.745403 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:21.745357 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" podStartSLOduration=2.180049984 podStartE2EDuration="4.745343119s" totalImagesPullingTime="2.565293135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:21.74308959 +0000 UTC m=+722.748527446" watchObservedRunningTime="2026-06-11 23:19:21.745343119 +0000 UTC m=+722.750780997" Jun 11 23:19:32.616623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:32.616581 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:32.617146 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:32.616874 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" podUID="4ea483ed-569b-4007-8489-c54b49ba7e98" containerName="limitador" containerID="cri-o://3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9" gracePeriod=30 Jun 11 23:19:32.617524 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:32.617479 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:33.176712 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.176649 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:33.250596 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.250551 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ea483ed-569b-4007-8489-c54b49ba7e98-config-file\") pod \"4ea483ed-569b-4007-8489-c54b49ba7e98\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " Jun 11 23:19:33.250806 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.250628 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfzct\" (UniqueName: \"kubernetes.io/projected/4ea483ed-569b-4007-8489-c54b49ba7e98-kube-api-access-gfzct\") pod \"4ea483ed-569b-4007-8489-c54b49ba7e98\" (UID: \"4ea483ed-569b-4007-8489-c54b49ba7e98\") " Jun 11 23:19:33.250951 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.250927 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea483ed-569b-4007-8489-c54b49ba7e98-config-file" (OuterVolumeSpecName: "config-file") pod "4ea483ed-569b-4007-8489-c54b49ba7e98" (UID: "4ea483ed-569b-4007-8489-c54b49ba7e98"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:19:33.251078 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.251066 2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ea483ed-569b-4007-8489-c54b49ba7e98-config-file\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:19:33.252635 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.252604 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea483ed-569b-4007-8489-c54b49ba7e98-kube-api-access-gfzct" (OuterVolumeSpecName: "kube-api-access-gfzct") pod "4ea483ed-569b-4007-8489-c54b49ba7e98" (UID: "4ea483ed-569b-4007-8489-c54b49ba7e98"). InnerVolumeSpecName "kube-api-access-gfzct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:19:33.352234 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.352184 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfzct\" (UniqueName: \"kubernetes.io/projected/4ea483ed-569b-4007-8489-c54b49ba7e98-kube-api-access-gfzct\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:19:33.684360 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.684324 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-tfz69"] Jun 11 23:19:33.684975 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.684955 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea483ed-569b-4007-8489-c54b49ba7e98" containerName="limitador" Jun 11 23:19:33.685055 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.684978 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea483ed-569b-4007-8489-c54b49ba7e98" containerName="limitador" Jun 11 23:19:33.685127 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.685097 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea483ed-569b-4007-8489-c54b49ba7e98" containerName="limitador" Jun 11 23:19:33.688362 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.688341 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:33.690897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.690866 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 23:19:33.706861 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.699555 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tfz69"] Jun 11 23:19:33.716094 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.716045 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:33.756095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.756057 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd2kf\" (UniqueName: \"kubernetes.io/projected/23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f-kube-api-access-pd2kf\") pod \"postgres-69fb4594cf-tfz69\" (UID: \"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f\") " pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:33.756265 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.756139 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f-data\") pod \"postgres-69fb4594cf-tfz69\" (UID: \"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f\") " pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:33.798492 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.798459 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ea483ed-569b-4007-8489-c54b49ba7e98" containerID="3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9" exitCode=0 Jun 11 23:19:33.798667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.798515 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" Jun 11 23:19:33.798667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.798516 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" event={"ID":"4ea483ed-569b-4007-8489-c54b49ba7e98","Type":"ContainerDied","Data":"3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9"} Jun 11 23:19:33.798667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.798630 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7kgv" event={"ID":"4ea483ed-569b-4007-8489-c54b49ba7e98","Type":"ContainerDied","Data":"a288664ce6f08c028b538cebaa2391f4a7790d19096006f5003c184a9abf5777"} Jun 11 23:19:33.798667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.798651 2571 scope.go:117] "RemoveContainer" containerID="3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9" Jun 11 23:19:33.807957 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.807934 2571 scope.go:117] "RemoveContainer" containerID="3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9" Jun 11 23:19:33.808228 ip-10-0-134-77 kubenswrapper[2571]: E0611 23:19:33.808211 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9\": container with ID starting with 3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9 not found: ID does not exist" containerID="3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9" Jun 11 23:19:33.808268 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.808236 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9"} err="failed to get container status \"3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9\": rpc error: code = NotFound desc = could not find container \"3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9\": container with ID starting with 3de9376e55c39d629f18ee7d721358567216da41057dee276847213e532fb3b9 not found: ID does not exist" Jun 11 23:19:33.816292 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.816248 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:33.819119 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.819097 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7kgv"] Jun 11 23:19:33.857220 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.857185 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f-data\") pod \"postgres-69fb4594cf-tfz69\" (UID: \"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f\") " pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:33.857387 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.857256 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd2kf\" (UniqueName: \"kubernetes.io/projected/23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f-kube-api-access-pd2kf\") pod \"postgres-69fb4594cf-tfz69\" (UID: \"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f\") " pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:33.857572 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.857551 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f-data\") pod \"postgres-69fb4594cf-tfz69\" (UID: \"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f\") " pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:33.865799 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:33.865779 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd2kf\" (UniqueName: \"kubernetes.io/projected/23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f-kube-api-access-pd2kf\") pod \"postgres-69fb4594cf-tfz69\" (UID: \"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f\") " pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:34.011793 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:34.011761 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:34.153410 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:34.153382 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tfz69"] Jun 11 23:19:34.154902 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:19:34.154871 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ac2b9a_cdfe_4570_bd3b_bf63ef78ba1f.slice/crio-f850d1a8efdb4f59874ba20002180ec51b1d4418bfd24706fa08607c2e4521e0 WatchSource:0}: Error finding container f850d1a8efdb4f59874ba20002180ec51b1d4418bfd24706fa08607c2e4521e0: Status 404 returned error can't find the container with id f850d1a8efdb4f59874ba20002180ec51b1d4418bfd24706fa08607c2e4521e0 Jun 11 23:19:34.806345 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:34.806307 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tfz69" event={"ID":"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f","Type":"ContainerStarted","Data":"f850d1a8efdb4f59874ba20002180ec51b1d4418bfd24706fa08607c2e4521e0"} Jun 11 23:19:35.395738 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:35.395698 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea483ed-569b-4007-8489-c54b49ba7e98" path="/var/lib/kubelet/pods/4ea483ed-569b-4007-8489-c54b49ba7e98/volumes" Jun 11 23:19:36.821197 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:36.821165 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tfz69" event={"ID":"23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f","Type":"ContainerStarted","Data":"b067b3a38013dfe92d23c62eed6a5c322b6c19372f35ca4a9fb95d6c610d8cdf"} Jun 11 23:19:36.821588 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:36.821294 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:36.838754 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:36.838697 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-tfz69" podStartSLOduration=1.279587303 podStartE2EDuration="3.838677005s" totalImagesPullingTime="2.559089702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:19:36.836768136 +0000 UTC m=+737.842205966" watchObservedRunningTime="2026-06-11 23:19:36.838677005 +0000 UTC m=+737.844114835" Jun 11 23:19:42.860342 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:42.860312 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-tfz69" Jun 11 23:19:43.191034 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:43.190941 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:43.285252 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:43.285208 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:43.430437 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:43.430404 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:44.400877 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.400812 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5"] Jun 11 23:19:44.407949 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.407919 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.410661 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.410628 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:19:44.411415 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.411390 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:19:44.411550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.411402 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6lvg8\"" Jun 11 23:19:44.412501 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.412479 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5"] Jun 11 23:19:44.560275 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.560238 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dkvw\" (UniqueName: \"kubernetes.io/projected/3b014d21-96eb-4699-b04f-59c9da59a3c4-kube-api-access-4dkvw\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.560462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.560297 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.560462 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.560423 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.661729 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.661631 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.661729 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.661711 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.661992 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.661742 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dkvw\" (UniqueName: \"kubernetes.io/projected/3b014d21-96eb-4699-b04f-59c9da59a3c4-kube-api-access-4dkvw\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.662131 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.662107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.662188 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.662162 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.675510 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.675480 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dkvw\" (UniqueName: \"kubernetes.io/projected/3b014d21-96eb-4699-b04f-59c9da59a3c4-kube-api-access-4dkvw\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.719098 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.719056 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:44.859948 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:44.859880 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5"] Jun 11 23:19:44.862819 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:19:44.862770 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b014d21_96eb_4699_b04f_59c9da59a3c4.slice/crio-75e512e615e1cd3f724ec5f64313cb78dc30a6d9cc0975f931f9af6c085cde9f WatchSource:0}: Error finding container 75e512e615e1cd3f724ec5f64313cb78dc30a6d9cc0975f931f9af6c085cde9f: Status 404 returned error can't find the container with id 75e512e615e1cd3f724ec5f64313cb78dc30a6d9cc0975f931f9af6c085cde9f Jun 11 23:19:45.876205 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:45.876170 2571 generic.go:356] "Generic (PLEG): container finished" podID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerID="5a9b9e572a7eacdb1afa800008d8813e1a5e7b8132ed6646743961fac719a937" exitCode=0 Jun 11 23:19:45.876611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:45.876226 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" event={"ID":"3b014d21-96eb-4699-b04f-59c9da59a3c4","Type":"ContainerDied","Data":"5a9b9e572a7eacdb1afa800008d8813e1a5e7b8132ed6646743961fac719a937"} Jun 11 23:19:45.876611 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:45.876264 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" event={"ID":"3b014d21-96eb-4699-b04f-59c9da59a3c4","Type":"ContainerStarted","Data":"75e512e615e1cd3f724ec5f64313cb78dc30a6d9cc0975f931f9af6c085cde9f"} Jun 11 23:19:46.884400 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:46.884360 2571 generic.go:356] "Generic (PLEG): container finished" podID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerID="85e279faeb960ec4885182b84d9a2d1e94091c35a30c5e9a9d4efe57a95cc0c5" exitCode=0 Jun 11 23:19:46.884900 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:46.884410 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" event={"ID":"3b014d21-96eb-4699-b04f-59c9da59a3c4","Type":"ContainerDied","Data":"85e279faeb960ec4885182b84d9a2d1e94091c35a30c5e9a9d4efe57a95cc0c5"} Jun 11 23:19:46.957781 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:46.957756 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:47.045704 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:47.045672 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:19:47.892345 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:47.892301 2571 generic.go:356] "Generic (PLEG): container finished" podID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerID="7285409a3a47d587d178c5add6953885287dae4086e430405f7ab413f06ba772" exitCode=0 Jun 11 23:19:47.892756 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:47.892381 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" event={"ID":"3b014d21-96eb-4699-b04f-59c9da59a3c4","Type":"ContainerDied","Data":"7285409a3a47d587d178c5add6953885287dae4086e430405f7ab413f06ba772"} Jun 11 23:19:49.120309 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.120272 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:49.203411 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.203320 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-bundle\") pod \"3b014d21-96eb-4699-b04f-59c9da59a3c4\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " Jun 11 23:19:49.203411 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.203375 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-util\") pod \"3b014d21-96eb-4699-b04f-59c9da59a3c4\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " Jun 11 23:19:49.203411 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.203401 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dkvw\" (UniqueName: \"kubernetes.io/projected/3b014d21-96eb-4699-b04f-59c9da59a3c4-kube-api-access-4dkvw\") pod \"3b014d21-96eb-4699-b04f-59c9da59a3c4\" (UID: \"3b014d21-96eb-4699-b04f-59c9da59a3c4\") " Jun 11 23:19:49.203888 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.203856 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-bundle" (OuterVolumeSpecName: "bundle") pod "3b014d21-96eb-4699-b04f-59c9da59a3c4" (UID: "3b014d21-96eb-4699-b04f-59c9da59a3c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:19:49.205558 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.205533 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b014d21-96eb-4699-b04f-59c9da59a3c4-kube-api-access-4dkvw" (OuterVolumeSpecName: "kube-api-access-4dkvw") pod "3b014d21-96eb-4699-b04f-59c9da59a3c4" (UID: "3b014d21-96eb-4699-b04f-59c9da59a3c4"). InnerVolumeSpecName "kube-api-access-4dkvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:19:49.211252 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.211223 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-util" (OuterVolumeSpecName: "util") pod "3b014d21-96eb-4699-b04f-59c9da59a3c4" (UID: "3b014d21-96eb-4699-b04f-59c9da59a3c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:19:49.304095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.304056 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dkvw\" (UniqueName: \"kubernetes.io/projected/3b014d21-96eb-4699-b04f-59c9da59a3c4-kube-api-access-4dkvw\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:19:49.304095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.304087 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:19:49.304095 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.304097 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b014d21-96eb-4699-b04f-59c9da59a3c4-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 11 23:19:49.906853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.906795 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" event={"ID":"3b014d21-96eb-4699-b04f-59c9da59a3c4","Type":"ContainerDied","Data":"75e512e615e1cd3f724ec5f64313cb78dc30a6d9cc0975f931f9af6c085cde9f"} Jun 11 23:19:49.906853 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.906819 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gbml5" Jun 11 23:19:49.907066 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:49.906869 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75e512e615e1cd3f724ec5f64313cb78dc30a6d9cc0975f931f9af6c085cde9f" Jun 11 23:19:57.759790 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.759754 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xzn6r"] Jun 11 23:19:57.760395 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760373 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="extract" Jun 11 23:19:57.760505 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760399 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="extract" Jun 11 23:19:57.760505 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760422 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="util" Jun 11 23:19:57.760505 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760430 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="util" Jun 11 23:19:57.760505 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760441 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="pull" Jun 11 23:19:57.760505 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760450 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="pull" Jun 11 23:19:57.760763 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.760577 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b014d21-96eb-4699-b04f-59c9da59a3c4" containerName="extract" Jun 11 23:19:57.762870 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.762850 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" Jun 11 23:19:57.765287 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.765266 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:19:57.766097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.766077 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:19:57.766194 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.766077 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-9mn78\"" Jun 11 23:19:57.772418 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.772393 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xzn6r"] Jun 11 23:19:57.886411 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.886371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkjv\" (UniqueName: \"kubernetes.io/projected/0c92de12-2d90-444a-a7c3-3c43ff8959ca-kube-api-access-qrkjv\") pod \"keycloak-operator-d67dbbb48-xzn6r\" (UID: \"0c92de12-2d90-444a-a7c3-3c43ff8959ca\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" Jun 11 23:19:57.987454 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.987404 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkjv\" (UniqueName: \"kubernetes.io/projected/0c92de12-2d90-444a-a7c3-3c43ff8959ca-kube-api-access-qrkjv\") pod \"keycloak-operator-d67dbbb48-xzn6r\" (UID: \"0c92de12-2d90-444a-a7c3-3c43ff8959ca\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" Jun 11 23:19:57.996887 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:57.996849 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkjv\" (UniqueName: \"kubernetes.io/projected/0c92de12-2d90-444a-a7c3-3c43ff8959ca-kube-api-access-qrkjv\") pod \"keycloak-operator-d67dbbb48-xzn6r\" (UID: \"0c92de12-2d90-444a-a7c3-3c43ff8959ca\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" Jun 11 23:19:58.074524 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:58.074438 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" Jun 11 23:19:58.254952 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:58.254927 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xzn6r"] Jun 11 23:19:58.257086 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:19:58.257040 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c92de12_2d90_444a_a7c3_3c43ff8959ca.slice/crio-e2d39d9f54b7313ab21958d08742c3c370901e271f4181f1bd9ba0cf23a934da WatchSource:0}: Error finding container e2d39d9f54b7313ab21958d08742c3c370901e271f4181f1bd9ba0cf23a934da: Status 404 returned error can't find the container with id e2d39d9f54b7313ab21958d08742c3c370901e271f4181f1bd9ba0cf23a934da Jun 11 23:19:58.970076 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:19:58.969986 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" event={"ID":"0c92de12-2d90-444a-a7c3-3c43ff8959ca","Type":"ContainerStarted","Data":"e2d39d9f54b7313ab21958d08742c3c370901e271f4181f1bd9ba0cf23a934da"} Jun 11 23:20:04.006592 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:04.006551 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" event={"ID":"0c92de12-2d90-444a-a7c3-3c43ff8959ca","Type":"ContainerStarted","Data":"ae7453be6daf7061cf80454a1cd78ab72480ca33247469c0f14644b33e9294a0"} Jun 11 23:20:04.022414 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:04.022366 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-xzn6r" podStartSLOduration=2.167966415 podStartE2EDuration="7.022350021s" totalImagesPullingTime="4.854383606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:20:04.021619939 +0000 UTC m=+765.027057789" watchObservedRunningTime="2026-06-11 23:20:04.022350021 +0000 UTC m=+765.027787850" Jun 11 23:20:12.194257 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:12.194211 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:12.299727 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:12.299692 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:41.727906 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:41.727799 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:41.970552 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:41.970513 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:47.139578 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:47.139537 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:47.262284 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:47.262237 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:47.360426 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:47.360390 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:47.550577 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:47.550538 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:50.186544 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:50.186508 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:20:50.279081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:20:50.279036 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:21:22.374239 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:21:22.374197 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:21:23.423634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:21:23.423600 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:21:41.287089 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:21:41.287051 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:21:41.390664 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:21:41.390577 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:21:56.485686 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:21:56.485656 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:22:19.434287 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:22:19.434200 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:22:19.434836 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:22:19.434658 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:22:19.442417 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:22:19.442395 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:22:19.442944 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:22:19.442921 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:22:42.653879 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:22:42.653818 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:23:00.731550 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:23:00.731510 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:23:00.791238 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:23:00.791205 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:10.537372 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:10.537329 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:16.189601 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:16.189521 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:16.292511 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:16.292468 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:23.844280 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:23.844239 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:38.311312 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:38.311273 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:46.778413 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.777535 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl"] Jun 11 23:24:46.781947 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.781924 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:46.784233 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.784208 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:24:46.784360 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.784256 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:24:46.785065 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.785041 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2cp8j\"" Jun 11 23:24:46.785186 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.785158 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 23:24:46.793562 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.793283 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl"] Jun 11 23:24:46.811577 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.811545 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:24:46.951045 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.951010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhz26\" (UniqueName: \"kubernetes.io/projected/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-kube-api-access-bhz26\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:46.951225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.951069 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:46.951225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.951099 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:46.951225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.951121 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:46.951225 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.951210 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:46.951380 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:46.951280 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.051924 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.051809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.051924 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.051875 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.051924 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.051916 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.052282 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.051959 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.052282 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.051999 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhz26\" (UniqueName: \"kubernetes.io/projected/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-kube-api-access-bhz26\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.052282 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.052051 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.052282 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.052263 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.052480 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.052305 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.052480 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.052325 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.054243 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.054222 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.054581 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.054562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.060300 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.060282 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhz26\" (UniqueName: \"kubernetes.io/projected/ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee-kube-api-access-bhz26\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl\" (UID: \"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.097138 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.097095 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:47.267937 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.267906 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl"] Jun 11 23:24:47.269396 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:24:47.269371 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0e7eb5_dd9c_43a2_9fdd_80f6baacbfee.slice/crio-8bbf2c471a330e5adf2e2f123a49db6f5f0a4581c49c9e22fb154c5f6e57fab3 WatchSource:0}: Error finding container 8bbf2c471a330e5adf2e2f123a49db6f5f0a4581c49c9e22fb154c5f6e57fab3: Status 404 returned error can't find the container with id 8bbf2c471a330e5adf2e2f123a49db6f5f0a4581c49c9e22fb154c5f6e57fab3 Jun 11 23:24:47.271290 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.271272 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:24:47.738588 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:47.738543 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" event={"ID":"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee","Type":"ContainerStarted","Data":"8bbf2c471a330e5adf2e2f123a49db6f5f0a4581c49c9e22fb154c5f6e57fab3"} Jun 11 23:24:50.762069 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:50.762027 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" event={"ID":"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee","Type":"ContainerStarted","Data":"e49e877af1a761a8d5465227423007217d390f1759bf576dd613b910eab84522"} Jun 11 23:24:51.769897 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:51.769859 2571 generic.go:356] "Generic (PLEG): container finished" podID="ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee" containerID="e49e877af1a761a8d5465227423007217d390f1759bf576dd613b910eab84522" exitCode=0 Jun 11 23:24:51.770377 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:51.769957 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" event={"ID":"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee","Type":"ContainerDied","Data":"e49e877af1a761a8d5465227423007217d390f1759bf576dd613b910eab84522"} Jun 11 23:24:53.784644 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:53.784608 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" event={"ID":"ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee","Type":"ContainerStarted","Data":"fb3e9f1e200663718ee76b65c43e6b7eddcf336fc339941075cab00212a21c3a"} Jun 11 23:24:53.805539 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:53.805480 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" podStartSLOduration=2.58572389 podStartE2EDuration="7.80546057s" totalImagesPullingTime="3.937161021s" totalInitContainerRuntime="1.282575659s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:24:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:24:53.802719058 +0000 UTC m=+1054.808156932" watchObservedRunningTime="2026-06-11 23:24:53.80546057 +0000 UTC m=+1054.810898415" Jun 11 23:24:57.097635 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:57.097600 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:57.098122 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:57.097761 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:57.110237 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:57.110211 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:24:57.822077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:24:57.822037 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl" Jun 11 23:25:05.824006 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:25:05.823966 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:25:19.741555 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:25:19.741432 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:25:35.601752 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:25:35.601691 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:25:39.424354 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:25:39.424299 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:27:19.477389 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:27:19.477359 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:27:19.479317 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:27:19.479291 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:27:19.485954 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:27:19.485928 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:27:19.487562 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:27:19.487542 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:29:02.552776 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:29:02.552737 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:30:30.668394 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:30:30.668350 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:31:51.014202 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:31:51.014154 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:19.520996 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:19.520963 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:32:19.525152 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:19.525129 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:32:19.528911 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:19.528884 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:32:19.532687 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:19.532663 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bxrrx_259952ae-371d-4eb0-94bf-f5d5c1c44965/ovn-acl-logging/0.log" Jun 11 23:32:25.190873 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:25.190843 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dd6984748-vvgzn_3355d20a-fd27-4382-9d63-6a322a30d172/nginx/0.log" Jun 11 23:32:25.299618 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:25.299589 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6qfs7_c96ad1e7-3397-4eb8-9733-a07532e35ea0/manager/0.log" Jun 11 23:32:25.420184 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:25.420152 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9rq5q_1af1c4c3-bf23-411f-b1e2-01763b6f5ebc/manager/0.log" Jun 11 23:32:25.911995 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:25.911970 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hr84p_4649daaa-31b6-491a-aa35-0bfcdf5668f9/server/0.log" Jun 11 23:32:26.037845 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:26.037795 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zdlqj_0604ed36-3fcf-43fa-8e72-80199b713033/manager/0.log" Jun 11 23:32:26.152871 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:26.152819 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-4p2dl_ea9dad07-9194-455f-8a59-31cf88d583ae/copy-manifests/0.log" Jun 11 23:32:26.159723 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:26.159699 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-4p2dl_ea9dad07-9194-455f-8a59-31cf88d583ae/manager/0.log" Jun 11 23:32:26.530298 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:26.530247 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tfz69_23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f/postgres/0.log" Jun 11 23:32:27.308805 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.308765 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d_f1ce1d71-8548-4a15-b7be-b261918c4514/util/0.log" Jun 11 23:32:27.315666 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.315637 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d_f1ce1d71-8548-4a15-b7be-b261918c4514/pull/0.log" Jun 11 23:32:27.322125 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.322102 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d_f1ce1d71-8548-4a15-b7be-b261918c4514/extract/0.log" Jun 11 23:32:27.434120 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.434079 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4_396af685-6d73-4674-98a9-090d8ffd58e2/util/0.log" Jun 11 23:32:27.440988 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.440958 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4_396af685-6d73-4674-98a9-090d8ffd58e2/pull/0.log" Jun 11 23:32:27.447606 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.447579 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4_396af685-6d73-4674-98a9-090d8ffd58e2/extract/0.log" Jun 11 23:32:27.562059 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.561982 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl_78b784b3-fe6f-4d1d-ae7b-b022241bde5b/util/0.log" Jun 11 23:32:27.568982 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.568957 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl_78b784b3-fe6f-4d1d-ae7b-b022241bde5b/pull/0.log" Jun 11 23:32:27.575564 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.575541 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl_78b784b3-fe6f-4d1d-ae7b-b022241bde5b/extract/0.log" Jun 11 23:32:27.686369 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.686338 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j_f53d2792-9311-40ac-ad08-d12beab86d76/util/0.log" Jun 11 23:32:27.693405 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.693374 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j_f53d2792-9311-40ac-ad08-d12beab86d76/pull/0.log" Jun 11 23:32:27.699750 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.699729 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j_f53d2792-9311-40ac-ad08-d12beab86d76/extract/0.log" Jun 11 23:32:27.929628 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:27.929523 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4znvp_8e47a166-229b-44a8-a1d6-d0b274d38671/manager/0.log" Jun 11 23:32:29.104164 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:29.104131 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nqs9f_e091f45c-e56d-4e0e-9f1c-f73f5e8b5489/discovery/0.log" Jun 11 23:32:29.330048 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:29.330006 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cd959c47-h7tbl_b433f12a-889a-4f77-b193-5378afad442f/kube-auth-proxy/0.log" Jun 11 23:32:29.777779 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:29.777746 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cbd7b74b-cf2pt_627f4c2a-08eb-4c6a-acc3-a8754010d1bb/router/0.log" Jun 11 23:32:30.384172 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:30.384141 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl_ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee/storage-initializer/0.log" Jun 11 23:32:30.393483 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:30.393459 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-44knl_ad0e7eb5-dd9c-43a2-9fdd-80f6baacbfee/main/0.log" Jun 11 23:32:35.361209 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:35.361170 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:35.461577 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:35.461540 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:38.260131 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:38.260051 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gk96x_0a9b7caa-b272-47ac-bc85-7d4a2d7aca6d/global-pull-secret-syncer/0.log" Jun 11 23:32:38.393403 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:38.393365 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7p8mc_329364ee-d2da-48a8-8645-06fd73c6cbf9/konnectivity-agent/0.log" Jun 11 23:32:38.500518 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:38.500485 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-77.ec2.internal_b9d047301ade34e187f662d0538c7f23/haproxy/0.log" Jun 11 23:32:42.104667 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:42.104629 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-h4b6d_f3efb30f-d4f4-450a-9d22-58fcedfd948a/sail-operator/0.log" Jun 11 23:32:43.134334 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.134299 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d_f1ce1d71-8548-4a15-b7be-b261918c4514/extract/0.log" Jun 11 23:32:43.156140 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.156106 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d_f1ce1d71-8548-4a15-b7be-b261918c4514/util/0.log" Jun 11 23:32:43.176743 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.176702 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594dm7d_f1ce1d71-8548-4a15-b7be-b261918c4514/pull/0.log" Jun 11 23:32:43.204665 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.204624 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4_396af685-6d73-4674-98a9-090d8ffd58e2/extract/0.log" Jun 11 23:32:43.225081 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.225048 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4_396af685-6d73-4674-98a9-090d8ffd58e2/util/0.log" Jun 11 23:32:43.246268 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.246232 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5sm4_396af685-6d73-4674-98a9-090d8ffd58e2/pull/0.log" Jun 11 23:32:43.271623 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.271590 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl_78b784b3-fe6f-4d1d-ae7b-b022241bde5b/extract/0.log" Jun 11 23:32:43.293500 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.293450 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl_78b784b3-fe6f-4d1d-ae7b-b022241bde5b/util/0.log" Jun 11 23:32:43.314398 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.314351 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cpcjl_78b784b3-fe6f-4d1d-ae7b-b022241bde5b/pull/0.log" Jun 11 23:32:43.340563 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.340528 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j_f53d2792-9311-40ac-ad08-d12beab86d76/extract/0.log" Jun 11 23:32:43.360651 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.360623 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j_f53d2792-9311-40ac-ad08-d12beab86d76/util/0.log" Jun 11 23:32:43.389125 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.389031 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g2t4j_f53d2792-9311-40ac-ad08-d12beab86d76/pull/0.log" Jun 11 23:32:43.448589 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:43.448555 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4znvp_8e47a166-229b-44a8-a1d6-d0b274d38671/manager/0.log" Jun 11 23:32:45.178759 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.178723 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/alertmanager/0.log" Jun 11 23:32:45.206938 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.206908 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/config-reloader/0.log" Jun 11 23:32:45.233277 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.233252 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/kube-rbac-proxy-web/0.log" Jun 11 23:32:45.256598 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.256562 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/kube-rbac-proxy/0.log" Jun 11 23:32:45.279096 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.279070 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/kube-rbac-proxy-metric/0.log" Jun 11 23:32:45.302519 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.302490 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/prom-label-proxy/0.log" Jun 11 23:32:45.324016 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.323989 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ace9088-f4f7-4c64-8af1-602b09232cd1/init-config-reloader/0.log" Jun 11 23:32:45.411373 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.411341 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-pn64n_4a35ff33-4d54-468c-8636-5cd0269c136e/kube-state-metrics/0.log" Jun 11 23:32:45.429765 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.429695 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-pn64n_4a35ff33-4d54-468c-8636-5cd0269c136e/kube-rbac-proxy-main/0.log" Jun 11 23:32:45.453503 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.453472 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-pn64n_4a35ff33-4d54-468c-8636-5cd0269c136e/kube-rbac-proxy-self/0.log" Jun 11 23:32:45.481487 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.481461 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58dcf9444f-k472h_40c7d88b-5a53-471b-a758-d00925bc42d3/metrics-server/0.log" Jun 11 23:32:45.528097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.528065 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-r82vn_86055f0e-dbab-4bf9-9578-b890b420db84/monitoring-plugin/0.log" Jun 11 23:32:45.653600 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.653572 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxp96_b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c/node-exporter/0.log" Jun 11 23:32:45.681818 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.681734 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxp96_b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c/kube-rbac-proxy/0.log" Jun 11 23:32:45.714578 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:45.714551 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxp96_b8351eaf-aa3b-4b0e-bab8-3b1c9d31c47c/init-textfile/0.log" Jun 11 23:32:46.218635 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.218602 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-xml8z_d5f56ad3-28bd-472a-aa3f-7bd4161304c9/prometheus-operator-admission-webhook/0.log" Jun 11 23:32:46.265720 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.265689 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fd7cfb4b6-jtfms_2766e4db-2d3d-4e74-beb7-d7ecb0f31eef/telemeter-client/0.log" Jun 11 23:32:46.291365 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.291317 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fd7cfb4b6-jtfms_2766e4db-2d3d-4e74-beb7-d7ecb0f31eef/reload/0.log" Jun 11 23:32:46.315649 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.315616 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fd7cfb4b6-jtfms_2766e4db-2d3d-4e74-beb7-d7ecb0f31eef/kube-rbac-proxy/0.log" Jun 11 23:32:46.373585 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.373556 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fb789b57-zd25w_d33727a0-9433-4ba6-87f1-be1223cbfd21/thanos-query/0.log" Jun 11 23:32:46.394591 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.394559 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fb789b57-zd25w_d33727a0-9433-4ba6-87f1-be1223cbfd21/kube-rbac-proxy-web/0.log" Jun 11 23:32:46.418254 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.418217 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fb789b57-zd25w_d33727a0-9433-4ba6-87f1-be1223cbfd21/kube-rbac-proxy/0.log" Jun 11 23:32:46.439077 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.439051 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fb789b57-zd25w_d33727a0-9433-4ba6-87f1-be1223cbfd21/prom-label-proxy/0.log" Jun 11 23:32:46.459514 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.459485 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fb789b57-zd25w_d33727a0-9433-4ba6-87f1-be1223cbfd21/kube-rbac-proxy-rules/0.log" Jun 11 23:32:46.481329 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:46.481293 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fb789b57-zd25w_d33727a0-9433-4ba6-87f1-be1223cbfd21/kube-rbac-proxy-metrics/0.log" Jun 11 23:32:48.512367 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.512325 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/1.log" Jun 11 23:32:48.521634 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.521602 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-lfk9x_b7f7f3f4-eb65-43e1-a505-ded255a53837/console-operator/2.log" Jun 11 23:32:48.695295 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.695263 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6"] Jun 11 23:32:48.698976 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.698956 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.701097 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.701065 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6m5b\"/\"openshift-service-ca.crt\"" Jun 11 23:32:48.701893 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.701869 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s6m5b\"/\"default-dockercfg-8thfr\"" Jun 11 23:32:48.702126 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.701926 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6m5b\"/\"kube-root-ca.crt\"" Jun 11 23:32:48.706113 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.706086 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6"] Jun 11 23:32:48.785055 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.784963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-proc\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.785055 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.785014 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-sys\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.785259 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.785125 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-podres\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.785259 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.785159 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-lib-modules\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.785259 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.785178 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4gr\" (UniqueName: \"kubernetes.io/projected/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-kube-api-access-jh4gr\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.885994 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.885959 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-proc\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.885994 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886001 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-sys\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886052 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-podres\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886073 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-lib-modules\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886088 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-proc\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886092 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4gr\" (UniqueName: \"kubernetes.io/projected/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-kube-api-access-jh4gr\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886218 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886159 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-sys\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886377 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886247 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-lib-modules\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.886377 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.886247 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-podres\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:48.894199 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:48.894177 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4gr\" (UniqueName: \"kubernetes.io/projected/e69bab70-ead3-4f76-afd5-6a46cc8b50b2-kube-api-access-jh4gr\") pod \"perf-node-gather-daemonset-t55w6\" (UID: \"e69bab70-ead3-4f76-afd5-6a46cc8b50b2\") " pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:49.010662 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.010624 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:49.124222 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.124195 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7ddf4b7bf-49db2_e6999196-91b6-48f9-aa07-e9ad1d8ed98b/console/0.log" Jun 11 23:32:49.152601 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.152572 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6"] Jun 11 23:32:49.154464 ip-10-0-134-77 kubenswrapper[2571]: W0611 23:32:49.154436 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode69bab70_ead3_4f76_afd5_6a46cc8b50b2.slice/crio-7e4e32e9c251fd80f7f007b1e6bffcc60b1de2867ca8949012a5c567d0738871 WatchSource:0}: Error finding container 7e4e32e9c251fd80f7f007b1e6bffcc60b1de2867ca8949012a5c567d0738871: Status 404 returned error can't find the container with id 7e4e32e9c251fd80f7f007b1e6bffcc60b1de2867ca8949012a5c567d0738871 Jun 11 23:32:49.170116 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.170081 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-5c8jv_df802e6c-a79a-48b9-bd56-236b0d6de8a8/download-server/0.log" Jun 11 23:32:49.703490 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.703451 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" event={"ID":"e69bab70-ead3-4f76-afd5-6a46cc8b50b2","Type":"ContainerStarted","Data":"22e0798d88a9999be8377609b9806b9088267cb8c7000853726939bf5af57ad8"} Jun 11 23:32:49.703951 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.703506 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" event={"ID":"e69bab70-ead3-4f76-afd5-6a46cc8b50b2","Type":"ContainerStarted","Data":"7e4e32e9c251fd80f7f007b1e6bffcc60b1de2867ca8949012a5c567d0738871"} Jun 11 23:32:49.703951 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.703609 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:49.722707 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:49.722658 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" podStartSLOduration=1.722642085 podStartE2EDuration="1.722642085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:49.721179441 +0000 UTC m=+1530.726617288" watchObservedRunningTime="2026-06-11 23:32:49.722642085 +0000 UTC m=+1530.728079914" Jun 11 23:32:51.077516 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:51.077490 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgvp6_10cc11ea-396d-4ceb-8985-e9e53914cc9f/dns/0.log" Jun 11 23:32:51.101309 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:51.101281 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgvp6_10cc11ea-396d-4ceb-8985-e9e53914cc9f/kube-rbac-proxy/0.log" Jun 11 23:32:51.230151 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:51.230123 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pzjf7_b92bb8ca-e3ea-4725-ba46-fa03d6f5db52/dns-node-resolver/0.log" Jun 11 23:32:51.826204 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:51.826162 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w6ztn_de5c634a-5ae9-4ca7-b9db-0539ef234807/node-ca/0.log" Jun 11 23:32:52.947452 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:52.947417 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nqs9f_e091f45c-e56d-4e0e-9f1c-f73f5e8b5489/discovery/0.log" Jun 11 23:32:53.006923 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:53.006895 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cd959c47-h7tbl_b433f12a-889a-4f77-b193-5378afad442f/kube-auth-proxy/0.log" Jun 11 23:32:53.106342 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:53.106308 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cbd7b74b-cf2pt_627f4c2a-08eb-4c6a-acc3-a8754010d1bb/router/0.log" Jun 11 23:32:53.693410 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:53.693378 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pc6c8_d68b326b-ee84-4b8a-8ba0-7ac9b8659708/serve-healthcheck-canary/0.log" Jun 11 23:32:54.247548 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:54.247515 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-9j85f_d85eef17-528e-4e24-be3f-d2306b8f2199/insights-operator/0.log" Jun 11 23:32:54.248111 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:54.247816 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-9j85f_d85eef17-528e-4e24-be3f-d2306b8f2199/insights-operator/1.log" Jun 11 23:32:54.339109 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:54.339078 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b9lv6_1f148b05-949b-465e-90b4-656e8cc2a6ec/kube-rbac-proxy/0.log" Jun 11 23:32:54.361381 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:54.361357 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b9lv6_1f148b05-949b-465e-90b4-656e8cc2a6ec/exporter/0.log" Jun 11 23:32:54.384985 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:54.384958 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b9lv6_1f148b05-949b-465e-90b4-656e8cc2a6ec/extractor/0.log" Jun 11 23:32:55.719202 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:55.719175 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s6m5b/perf-node-gather-daemonset-t55w6" Jun 11 23:32:56.712409 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.712376 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dd6984748-vvgzn_3355d20a-fd27-4382-9d63-6a322a30d172/nginx/0.log" Jun 11 23:32:56.736092 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.736056 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6qfs7_c96ad1e7-3397-4eb8-9733-a07532e35ea0/manager/0.log" Jun 11 23:32:56.776406 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.776370 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9rq5q_1af1c4c3-bf23-411f-b1e2-01763b6f5ebc/manager/0.log" Jun 11 23:32:56.871015 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.870979 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hr84p_4649daaa-31b6-491a-aa35-0bfcdf5668f9/server/0.log" Jun 11 23:32:56.938269 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.938234 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zdlqj_0604ed36-3fcf-43fa-8e72-80199b713033/manager/0.log" Jun 11 23:32:56.965687 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.965596 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-4p2dl_ea9dad07-9194-455f-8a59-31cf88d583ae/manager/0.log" Jun 11 23:32:56.985961 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:56.985937 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78f979bd8b-4p2dl_ea9dad07-9194-455f-8a59-31cf88d583ae/copy-manifests/0.log" Jun 11 23:32:57.131595 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:57.131568 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tfz69_23ac2b9a-cdfe-4570-bd3b-bf63ef78ba1f/postgres/0.log" Jun 11 23:32:58.750232 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:32:58.750198 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hkd42_d839dcd9-0a24-45be-a5b3-aed76cfa8b36/openshift-lws-operator/0.log" Jun 11 23:33:03.125720 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:03.125687 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nqs9f_e091f45c-e56d-4e0e-9f1c-f73f5e8b5489/discovery/0.log" Jun 11 23:33:03.151647 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:03.151615 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cd959c47-h7tbl_b433f12a-889a-4f77-b193-5378afad442f/kube-auth-proxy/0.log" Jun 11 23:33:03.209082 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:03.209038 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cbd7b74b-cf2pt_627f4c2a-08eb-4c6a-acc3-a8754010d1bb/router/0.log" Jun 11 23:33:04.401302 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:04.401245 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nqs9f_e091f45c-e56d-4e0e-9f1c-f73f5e8b5489/discovery/0.log" Jun 11 23:33:04.432936 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:04.432899 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cd959c47-h7tbl_b433f12a-889a-4f77-b193-5378afad442f/kube-auth-proxy/0.log" Jun 11 23:33:04.496502 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:04.496465 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cbd7b74b-cf2pt_627f4c2a-08eb-4c6a-acc3-a8754010d1bb/router/0.log" Jun 11 23:33:05.817946 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.817911 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/kube-multus-additional-cni-plugins/0.log" Jun 11 23:33:05.840162 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.840131 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/egress-router-binary-copy/0.log" Jun 11 23:33:05.860994 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.860961 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/cni-plugins/0.log" Jun 11 23:33:05.881889 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.881859 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/bond-cni-plugin/0.log" Jun 11 23:33:05.906104 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.906071 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/routeoverride-cni/0.log" Jun 11 23:33:05.929192 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.929156 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/whereabouts-cni-bincopy/0.log" Jun 11 23:33:05.948862 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:05.948817 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ksgm8_e15ca259-a328-4d71-8283-b2379cc88c39/whereabouts-cni/0.log" Jun 11 23:33:06.165895 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:06.165801 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nqs9f_e091f45c-e56d-4e0e-9f1c-f73f5e8b5489/discovery/0.log" Jun 11 23:33:06.190078 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:06.190050 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77cd959c47-h7tbl_b433f12a-889a-4f77-b193-5378afad442f/kube-auth-proxy/0.log" Jun 11 23:33:06.252187 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:06.252155 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69cbd7b74b-cf2pt_627f4c2a-08eb-4c6a-acc3-a8754010d1bb/router/0.log" Jun 11 23:33:06.375286 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:06.375251 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lzhsk_4a4fb35d-0821-4354-9fdf-f91fc3af357d/kube-multus/0.log" Jun 11 23:33:06.489579 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:06.489544 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4dj7_d131b1ac-7e95-40c6-8270-c2e0dad06d82/network-metrics-daemon/0.log" Jun 11 23:33:06.510580 ip-10-0-134-77 kubenswrapper[2571]: I0611 23:33:06.510548 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4dj7_d131b1ac-7e95-40c6-8270-c2e0dad06d82/kube-rbac-proxy/0.log"